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"This  Supplement  to  the  Handbook  of  Forecasting  Techniques  (IWR  Contract  Report 
75-7)  is  in  two  parts:  Part  1 consists  of  brief  descriptions  of  the  73  fore- 
casting techniques  presented  to  a group  of  Corps  planners  for  selection  for 
inclusion  into  the  Handbook.  Each  technique  is  explained  in  a one-page  descrip- 
tion designed  to  answer  simple  questions  such  as:  What  is  it?  What  do  you  get? 
How  do  you  do  it?  and  What  do  you  need?  This  part  should  prove  to  be  a valuable 
reference  to  the  users  of  the  Handbook  in  terms  of  coverage  and  format  of  presen- 

^®££2iL^;^—-«»«-————.p-p——ppp———.— ——————— 

00  , '.STn  W7J  «*t«om  or  • MOV  ..  it  oswiet.  UNCUSSIFIED 

IECUR1TY  CLRBBIRICATION  OR  THIB  PAOE  i'RNp"  DRtpTnrwtrt 


INTRODUCTION 


This  Supplement  to  the  Handbook  of  Tore casting  Techniques  (IWR 
Contract  Report  75-7)  ia  in  two  parte:  Pert  1 consists  of  brief  des- 
criptions of  the  73  forecasting  techniques  presented  to  a group  of 
Corps  planners  for  selection  for  inclusion  into  the  Handbook.  Each 
technique  is  explained  in  a one-page  description  designed  to  answer 
simple  questions  such  as:  What  is  it?  What  do  you  get?  How  do  you 

do  it?  and  What  do  you  need?  This  part  should  prove  to  be  a valuable 
reference  to  the  users  of  the  Handbook  in  terms  of  coverage  and  format 
of  presentation. 

Tart  1 of  the  Supplement  contains  31  forecasting  techniques 
described  in  some  detail.  These  techniques  were  selected  from  the 
73  listed  in  Part  1.  Twenty-five  of  these  31  techniques  were  finally 
collapsed  into  12  for  more  detailed  treatment  in  the  Handbook.  This 
part  should  also  be  a valuable  addition  to  the  Handbook  because  it 
provides  easy-to-read  but  informative  discussion  of  the  most  popular 
techniques  used  by  forecasters. 

The  material  presented  in  the  Supplement  was  prepared  by  the 
Center  for  the  Study  of  Social  Policy,  Stanford  Reaearch  Institute 
and  was  provided  IWR  as  a byproduct  of  the  research  contract  that  produces 
the  Handbook.  Funds  for  printing  the  supplement  are  from  OCE  (CWP-S). 


List  of  73  Forecasting  Techniques 


Cost-Benefit  Analysis 

( Statistical  Models  (Bayesian)  ) 

Marginal  Analysis 
KSIM 

Mission  Flow  Diagrams 

< 

Parameter  Analysis 
Cross-Impact  Matrix 
Input-Output  Analysis 

World  Oil  Price  Simulation  I 

Breakthroughs  j 

Precursor  Events  } 

! 

Econometric  Forecasting  1 

Dynamic  Models  j 

| 

Structural  Models  ; 

'j 

! 

Decision  Theory  j 

Morphological  Modelling 

Decision  Matrices  ‘ 

Relevance  Trees 

Theoretical  Limits  end  Barriers  I 

Analysis  of  Industrial  Behavior  I 

Technological  Audit  j 

Social  Trend  Analysis  ! 

I 

1 

Scenario  Writing  j 

Canonical  Trend  Variation 

i 


SurpriBe-Free  Projections 

Social  Indicators 

Leading  Indicators  (Economic) 

Change  Signals  Monitoring 
Critical  Factors  Analysis 
Estimates  of  Preferences 
Subjective  Estimates  of  Probability 
Prediction  of  Change-Over  PointB 
Amplitude-Adjusted  Index 
Diffusion  Index 

Authority  or  "Genius"  ■ > .casting 
Surveys  of  Intentions  or  Attitudes 
Surveys  of  Activities  or  Units 
Panels 
Delphi 

Psychographics  or  Life  Style 
Activities,  Interests,  Opinions 
Life  Ways 

Historical  Analogy 
Alternative  Futures  (FAR) 
Divergence  Mapping 
Introspective  Forecasting 
Utopias/Dystopias 
ModeB  and  Mechanisms  of  Change 
Study  of  Forces  of  Change 
Macro  Historical  Cycles 


Cross-Cultural  Comparisons 


Synectlcs 

Brainstorming 

Bionics 

Scienca  Fiction  as  Forecasts 
Exponential  Smoothing 
Simple  Regression 
Moving  Averages 
Multiple  Regression 
Envelope  Curves 
Growth  Curves 
Link-Relative  Prediction 
Box-Jenkina 
Cycle  Analysis 

Environmental  Systems  Analysis 
Risk  Analysis  Simulation 
Contextual  Mapping 
SRI  Gulf  Energy  Model 
Games 

Policy  Capture 
Probabilistic  Forecasting 
Normex  Forecasting 
Substitution  Forecasting 


1 


Steiner  1969 


p.  412 


FORECASTING  EVALUATION  FORM  #1 


What  Is  it? 


Nana;  BENEFIT-COST  ANALYSIS 

Deflnitlon/descrlption;  A technique  to  measure  the  coate  of  an  alternative 
courae  of  action  to  achieve  some  objective  against  the  benefits  resulting 
from  taking  that  courae. 

History /degree  of  provennaaa/promlaa ; As  a tool  for  government  policy,  C/B 
was  first  adopted  by  Corps  planners  using  procedures  described  in  the 
famous  "Green  Book",  C/8  associated  with  system  analysis  had  greatest 
development  in  the  Department  of  Defense  during  the  administration  of 
Secretary  McNamara. 

WHAT  DO  YOU  GET? 


Usee  and  limitations;  Where  Important  factors  in  a problem  cannot  be 

measured  in  monetary  terms,  or  where  such  measurement  is  very  difficult 
and  uncertain,  cost  benafit  analysis  can  be  very  useful, 

Form(s)  of  Output!  Lists  of  alternatives  in  order  of  preference  based  on 
specific  criteria.  Also,  monetary  values  of  estimated  costs  and  benefits 
for  each  alternative  and  the  ratio  of  C/B  for  each. 

Level  of  Detail;  Can  be  tailored  to  fit  a particular  problem  and  is  uniquely 

~ constructed  for  that  problem. 

level  of  Confidence:  High  when  good  data  are  combined  with  intuitive  insights. 

Span  of  Forecast:  Short-  to  long-range  forecasts.  Often  cover  20  years. 

HOW  DO  YOU  DO  IT? 


Procedures ; Yes,  but  not  "cut  and  dry".  Requires  invention  on  the  part  of 
the  analyst. 

1.  Identify  promising  alternatives 

2.  Design  the  models  and  criteria 

3.  Assess  the  Costs  (-)  and  Benefits  (+) 

4.  Apply  the  criteria 

WHAT  DO  YOU  NEED?  ' 


Data  requirements  and  availability:  Problem  dependent  but  always  need  costB 

for  certain  components  and  subjective  estimates  for  others. 

People,  Including  Organisational  Back-up;  Wide  range  of  costs  and  people, 

from  single  analyst  with  a pencil  to  large  teams  utilizing  computer  backup. 

Time;  Several  weeks  to  several  years. 

Money ; Medium  to  high  (?) 


(Wheelwright,  ji.  17/*) 


FORECASTING  EVALUATION  FORM  H 


WilAT  rs  IT? 


Name:  STATISTICAL  MODELS  (Bayesian) 

Pi  finltion/descriptlon:  Baycaian  atatiatica  allows  one  to  establieh  certain 

confidence  interval  a and  atatistics  that  can  be  used  to  check  the  validity 
of  a model. 

History /degree  of  ptovenness/promlae:  "Mathematical  sound" 

Power:  Complementary  to  other  forecasting  techniques.  Can  actually  be 

used  with  decision  analysis  an  a subjective  probability  estimate. 

WHAT  DO  YOU  GET? 


Uses  and  limitations:  forecasts  in  which  historical  data  is  not  available. 

Allows  one  to  deal  with  uncertainty  in  a decision-making  situation. 
Forecasts  based  on  subjective  probability  estimates  and  a statistical 
model  - generally  Bayesian  statistics. 

Formfs)  of  Uut pat:  "Knowledge  1b  power  only  if  man  knows  which  facta  not  to 

bother  with."  Entire  range  of  possible  values  - lots  of  output;  maybe 
overwhelming.  Should  be  done  in  stepwise  fashion— a little  data,  then 
evaluate. . . 

Level  of  Detail;  Specific,  detailed,  numerical  resultB. 

Level  of  Confidence:  Analyses  sre  only  as  reliable  ns  the  probabilities 

assigned  to  the  various  events. 

Span  of  Fore-east:  Short-term. 


HOW  Do  YOU  pn  IT? 
Procedures:  Yes. 


1.  Druw  the  decision  tree. 

2.  Determine  the  values  of  each  path. 

3.  Assign  the  probabilities  to  the  uncertain  events. 

4.  "Calculate"  the  expected  values  (Foldbnck  or  Monte  Carlo), 

5.  Identify  best  action  to  take. 


L 


WHAT  DO  YOU  NEED? 

Data  requirements  and  availability:  Can  be  based  on  information  that  already 

exists  within  the  ''office,*1 2 3 4 5  or  of  which  the  planner  doing  the  estimating 
is  aware.  Aval  lability  problem  in  working  across  organizational  llnuB 
to  get  estimates  from  others. 

People,  Including  Organizational  Back-up;  Kequires  the  users  to  have  a better 
understanding  of  statistics  and  mathematics  than  do  nonBtatlBtlcal  models. 

Time;  Manager's  time  plus  training  and  guidance  in  developing  the  ability 
to  make  subjective  probability  estimates. 

Money:  Cum:  mainly  associated  witli  "decision-maker's"  time. 


Steiner 


FORECASTING  EVALUATION  FORM  ill 


WHAT  IS  IT? 


Name;  MARGINAL  ANALYSIS 

Definition/description;  A technique  for  optimizing  output  with  a given  input. 
Focuses  attention  on  the  question:  What  difference  does  the  next  move 

make?  It  accentuates  the  variables  in  a situation  and  underplays  averages 
and  constants. 

History/degree  of  provennoss/proBlse:  Used  prior  to  1963  by  Continental  Air 

Lines.  It  seems  to  work. 

Promise:  I do  not  see  Corps  application. 

WHAT  DO  YOU  GET? 


Uses  and  limitations;  Used  whenever  it  is  possible  to  calculate  the  marginal 
cost  of  doing  something  Versus  the  marginal  return,  such  as  optimizing 
business  profits  by  pricing  goods  and  services,  or  determine  worth- 
whileness, Limitation:  (letting  nccurate  data  about  the  impact  of  making 

a decision  to  produce  or  not  to  produce  that  last  unit. 

Fora (a)  of  Output:  Comparison  of  marginal  cost  versus  marginal  return  for  a 

specific  question. 

Level  of  Detail:  Detailed  and  specific. 

Level  of  Confidence:  Better  than  trend  extrapolation  when  applied  to  correct 

situation.  Cun  bo  a guide  to  increase  profits  when  the  marginal  difference 
can  be  calculated. 

Span  of  Forecast:  Short-term, 

HOW  DO  YOU  DO  IT? 


I'  rncedures : Not  stated  In  Steiner. 

WHAT  1)0  Y()U  NKKD ? 


Until  requirements  untl  availability:  Requires  data  about  Incremental  Income 

■ irttl  costs. 


1 ' uuj 1 le.  Including  i U;^un  I ant  Ion,  ij lb  i ch_o  : 


T inn' : 


Moi_n.v; 


} , 

t i.iieso 


I "W  level  ol  . i lei'  and  money. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 


Name i KSIM 

Definltlon/descrlptlon;  Simulation  technique  that  allows  a group  of  "axperta" 
from  different  disciplines  to  evnluata  the  interactions  among  variables 
and  teat  alternatives. 

Hlstory/degree  of  provennosg/promlsei  Developed  by  Dr.  J.  Kane,  University 
of  British  Colunbla,  1970.  Some  15  reported  useful  applications. 

Great  promise. 


WHAT  DO  YOU  GET? 


Uses  and  limitations!  Useful  in  problem  formulation,  needs  identification  and 
communication.  Allows  planners  to  understand  system  structure,  relate 
quantitative  and  qualitative  factors,  and  communicate  the  outcome  of 
proposed  planning  interventions. 

Limitations!  Aggregate  variables,  and  structural  relationships  and  does 
not  give  precise  numerical  answers. 

Forms (s)  of  Output!  Time  series  data  of  system  variables  over  time  and/or 
plots. 

Level  of  Detail!  Aggregate  (8-10  variables) 

Level  of  Confidence!  A little  better  than  pure  judgment,  with  the  utilisation 
of  statistical  data. 

Span  of  Forecast ! Long-term. 


HOW  DO  YOU  DO  IT? 


Procedures : Yes. 


1.  Define  the  problem 

2,  Select  the  variables 
'.  Crons  impact 

A.  Refine  model 
5.  Test  nlternnt  Ives 


WHAT  DO  YOU  NEED? 


Data  requirements  and  availability;  Some  quantitative  dula  required. 

Usunllv  readily  available. 


People,  1 nr  Lud  I ng  Org.inlzat  lon.il  Back-up:  "Experts"  Iron  4-10  discipl  . ou  . 

Computer  program  and  on-line  capability. 


Time: 


1 week  workshops  averap.i- 


Norm;1 live 


Martino  p.  ! 17- 3 JO 


FORECASTING  EVALUATION  rORM 


J 


ill 


WHATIS IT? 


Name;  MISSION  FLOW  DIAGRAMS 

Deflnltion/descriptlon:  A normative  or  goal-netting  method  of  forecasting, 

used  to  Identify  bottlenecks  which  prevent  the  realization  of  otherwise 
promising  paths.  These  bottlenecks  can  then  serve  as  targets  for 
advancement  efforts. 

Definition/description;  A normative  or  goal-setting  method  of  forecasting. 

History/degree  of  provenness/nromlae:  Devised  by  Dr,  Harold  Linstoie. 

Subjective  process  unknown  degree  nf  preventions.  Need  more  information. 
Promise;  Likely  to  appeal  to  Corps. 

WHAT  DO  YOU  GET? 


Uses  and  limitations;  Analysis  of  any  sequential  process  to  identify  diffi- 
*"  cuities  and  costs  associated  with  each  route.  Also  test  new  routes. 
Performance  requirements  can  then  be  derived  and  used  as  normative 
forecasts.  "Tend  to  organize  and  structure  the  problem  and  aBBure 
completeness."  Therefore,  disadvantage ; impose  rigidity  that  may  distort 
problem.  Also  numbers,  no  matter  how  subjective,  tend  to  create  their 
own  validity. 

Form(s)  of  Output.;  Flow  Diagrams  showing  many  paths  from  Point  A to  Point  U. 

Level  of  Detail;  Problem  dependent:  from  aggregate  to  detailed.  Technique 

is  flexible. 

Level  of  Confidence;  Subjective  unJ  depends  upon  the  .Individuals  making 
the  decisions. 

Span  of  Forecast;  Again,  problem  dependent;  short-term  to  long-term. 

Major  application  may  be  in  framework  studios. 

HOW  IK)  YOU  1)0  IT? 


11*72 • Mapping  all  the  alternative  routes  or  sequences  by  which  some 
mission  or  task  can  be  accomplished.  Alternative  routes,  not.  curre.nl.Jy 
available,  mav  be  postulated,  for  will,  h normative  forecasts  are  then 
developed.  Numerical  weights  simtlai  to  PATTERN  ran  be  assigned  In 
alternative  paths  of  a mission  I low  d lag  ram.  (What  .Is  PATTERN?  Sec 
Wheelwright,  i 7 . j 

WHAT  DO  YOU  Ni:K|v.* 


Data  requirement.:;  tad  avaUubi  illy: 


t 


Need  to  'Ill'll:  other  Source:* . 


Quinn,  1967 


f 


(■ 


f: 


f. 
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FORECASTING  EVALUATION  FORM  111 


WHAT  IS  IT? 

Name:  Demand  Assessment  (Darracott,  1967,  p.  4-44)  nothing. 

PARAMETER  ANALYSIS  - Quinn,  Janes  B.,  "Technological  Forecasting," 
Harvard  Business  Review,  Mar/April  1967. 

Deflnltlon/descrlptlon:  A way  to  structure  thinking  for  short-term  technical 

changes . 

1.  Demand  Assessment— Corps  might  relate,  but  little  or  no  structure. 

2.  Theoretical  Limits 

3.  Parameter  Analysis— sounds  good. 

History/degree  of  provanness/promlset  Used  by  RAND  in  the  early  1960’s. 

WHAT  DO  YOU  GET? 


Uses  and  limitations:  Predicting  Technological  Changeover  Points 
Analyzing  Unique  Properties  of  a Product 
Trends  in  Plotting  Technical-Economic  Performance 
Analyzing  Substitution  Growth  Curves 


Form(s)  of  Output:  Plotted  or  tabular  range  of  costs  for  variouB  alternatives. 

Level  of  Detail  I Detailed  costs. 

Level  of  Confidence:  Judgmental  and  data  dependent.  No  feedback  built  in 

for  review. 

Span  of  forecast:  Short-term  detailed  studies. 

HOW  DO  YOU  DO  IT? 


Procedures : Yes:  1.  Select  performance  characteristics  (one  to  three) 

which  can  he  quantified. 

2.  Include  ranges  and  most  likely  values 
J.  Identify  precisely  the  phase 

4.  Document  the  major  assumptions 

5.  Include  best  estimates  or  probability 

WHAT  DO  YOU  NiCKD? 


Data  requirements  and  availability:  Present  cost  and  expected  full 

must  be  specified. 

Peoj  to.  Including  Organizational  Back-up:  Economist,  Data  an 

Time:  Medium 

Money:  Low  to  medium. 

I'oip'i  Value:  Low,  un I rime  details  can  be  obtained. 
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Martino  1972,  p.  271-286 


FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 


Nana;  CROSS-IMPACT  MATRIX 

Pafinitlon/dtscriptionl  Comparison  of  individual  forecasts,  on  a pair-wise 
basis,  to  determine  whether  there  are  any  interactions;  or  provides  a 
systematic  method  for  examining  the  interactiona  among  several  forecasts. 

Hlatorv/dearee  of  provenneas /promise:  Devised  by  T.  Gordon  and  0.  Kelmar  in 

~ the  iate  1960's,  Numerous  applications— it  works.  High  degree  of 

promise. 

WHAT  DO  YOU  GET? 


Uses  and  limitations;  Compare ion  of  forecasts  and  testing  policies.  Provides 
greater  clarification  of  issues  and  better  definitions  of  the  risk  and 
uncertainties  in  the  subject  being  forecast,  as  well  as  a more  complete 
and  consistent  picture  of  Borne  future  time  period. 

Limitations i Number  of  forecasts  and  possible  method  inflexibility. 

Form(s)  of  Output!  A matrix  of  events  in  rows  and  columns  depicting  the 
Interaction  between  events. 

Level  of  Detail;  While  extensive  detail  is  possible  (over  25  events),  the 
procedure  becomes  tedious  and  evaluation  complex. 

Level  of  Confidence!  Judgmental,  but  use  of  experts  and  probabilities  provides 
for  extensive  feedback  and  review. 

Span  of  Forecast;  Flexible  (long-  or  short-term)  and  determined  by  nature 
of  events. 

HOW  DO  YOU  DO  IT7 


Procedures:  Yes,  very  systematic.  Events  are  suggested  with  probabilities 

and  year  of  occurrence.  EventB  are  then  arranged  in  columns  and  rows. 

The  interaction  between  events  1b  shown  in  terms  of  mode  (enhance, 

enables, ...prevents);  strength  (103.. .1002)  and  time  lag  (immediate. . ,x  years) . 

WHAT  DO  YOU  NEED? 


Data  requirements  and  availability:  Forecasta  - the  source  of  these  is  after 

dclphi  or  panel  but  can  be  from  any  source. 

People.  Including  Organisational  Back-up:  Need  "experts"  to  determine  events, 

probability  and  time  of  occurrence.  Also,  must  evaluate  the  interactions 
among  events. 

Time;  1 day  to  1 year,  depending  upon  complexity:  median  1 month. 

Money : Range:  modest  to  high.  Depends  upon  complexity  of  events,  type  of 

Experts"  and  whether  a computer  is  utilized. 


7 


Chriaholm  & Whitaker  1971 
Wheelwright  1971,  p.  141 


FORECASTING  EVALUATION  FORM  01 


WHAT  IS  IT 7 


Name  I INPUT/OUTPUT  ANALYSIS 

D«f inltion/deicriptiom  I/O  Analysis  la  a descriptive  nodal  of  an  economy . 
It  la  a form  of  national  Income  accounting  that  summarizes  all  "taking" 
and  "giving"  among  and  within  all  lnduatriee  and  between  them  and  the 
final  conaumer. 

Hlatoty /degree  of  pravenneaa/prowlaai  O.K.  for  a ahort-tera,  "precise," 
bunch  of  numbera  and  an  extremely  narrowly  defined  objective— Corpa  will 
like  it.  Can  help  plannere  determine  If  material  goala  can  be  achieved, 
i.e..  increaelng  reaidential  conatruction  will  require  steel,  cement, 
bricks,  trucks,  cranes,  nachinery,  glass,  wood,  etc.  How  much  will  it 
coat  and  what  changes  will  have  to  be  Introduced  to  meet  objectives? 

WHAT  DO  YOU  GET? 


Uaea  and  limitations!  I/O  main  usefulness  Is  for  planning  purposes  at  the 

level  of  a national  economy.  Main  value  in  planning  rather  than  forecasting. 
Limitations i Baaed  on  linear  homogeneous  production  function  and  the 
assumption  that  I/O  coefficients  have  not  changed— good  luck.  Works 
batter  in  France  or  USSR,  since  1/0  basically  assumes  a constant  technology. 

Level  of  Detail i Extremely  detailed. 

Level  of  Confidence!  Used  to  have  high  lsvel  of  acceptance.  However,  current 
economics  situation  tends  to  lower  confidence  in  "economics"  in  general. 
Results  as  good  ns  the  Input  data. 

Span  of  Forecast;  Broud  range  of  applications— short  detailed  to  medium. 

HOW  DO  YOU  DO  IT? 


Procedures:  Well-structured  mathematical  analysis  (matrix  inversion) , 

WHAT  DO  YOU  NF.KU? 


Data  requirements  and  availability:  Based  entirely  on  available  and  manipulated 

data.  While  extensive  data  required,  it  is  generally  available.  Problem 
is  getting  the  data  in  a consistent  form  and  agreeing  on  level  of  aggre- 
gation and  what  to  Include. 

People.  Including  Organizational  back-up:  Economist.  Data  Analyst.  Math- 

ematician. Usually  required  computer  application. 

Time:  Medium  to  long  (1  year) 

Money:  Medium  to  expensive  to  construct. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 


Name:  WORLD  OIL  PRICE  SIMULATION  (WOPS) 

Definltlon/descrlptioni  Combines  several  forecasting  techniques!  econo- 
metric model,  dynamic  simulation,  heuristic  overlay  (programmed  to  learn), 
and  computer/analyst  interaction. 

History/dagrae  of  provenness /promise!  Under  development.  Initial  testing 


to  be  completed  by  February  1975. 

WHAT  DO  YOU  GET? 

Uses  and  limitations!  Forecasts  world  oil  prices.  Main  application  for 
planning  and  policy  decisions  in  setting  prices. 

Limitations!  Single  purpose,  untested. 

Form(s)  of  Output!  Graphs  of  price  strategies  for  maximum  total  discounted 
(net  revenue) 

Level  of  Detail!  Aggregate:  Five  sectors  for  the  whole  world. 

Level  of  Confidence!  High  lovel  of  confidence. 


Span  of  Forecast!  Medium  - 10  years  (1985) 


HOW  DO  YOU  DO  IT? 

Procedures!  Computer/analyst  dialogue.  Using  PDP10  computer.  Interactive 
simulation  routine. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability!  Entire  data  base  on  line,  however,  not 
available. 

People.  Including  Organisational  Back-up!  To  build  the  system  requires  a large 
team  of  analysts,  programmers,  economists,  and  planners. 

Time!  9 months,  development. 

Money!  $50,000,  development.  User  costB  not  yet  established. 


A 
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[ FORECASTING  EVALUATION  FORM  #1 

WHAT  IS  IT 7 

f Nana:  BREAKTHROUCHS 

• Dcflnltlon/description:  Systematic  aaaking  out  of  pracuraor  events  in  order 

[ to  identify  potential  signals  in  hypothesizing  a pattern  or  breakthrough. 

A breakthrough  ia  something  which  appears  to  transcend  prior  limitations. 

Hlstory/degrecof  provenneas/promise i At  least  since  1970.  One  application 
sited.  Also  used  by  Kahn  and  Wiener.  High  degree  of  promise  as 
1 information  discrimination  increases,  (used  by  LRPS  and  CEH  at  SRI). 

WHAT  DO  YOU  GET? 


Uses  and  limitations i Primary  purpose  is  analysis,  not  data  gathering,  used 
to  watch  for  technological  breakthroughs  and  to  obtain  warning  of  any 
other  shifts  in  the  environment  which  might  affect  "the  buainess," 
Limitations i No  "sure  way"  to  assign  threshold.  Difficulty  in  separating 
signals  Irom  noise. 

Forw(s)  of  Outputi  Folders  of  clippings, 

Level  of  Detail i Study  dependent,  but  no  limits  inherent  in  the  technique, 
files  can  be  extremely  detailed  or  quit*  aggregate. 

Level  of  Confidence;  Judgmental. 

Span  of  Forecast l Identification  of  new  patterns  (long-term). 

HOW  DO  YOU  DO  IT? 


Procedures:  collection:  information  enters  the  system  by  collecting  data 

in  specified  sectors  from  prospective  sources, 
screening:  based  on  needs  and  goals 

evaluation:  sketching  patterns  and  purging 

threshold  setting:  balancing  the  risk  of  actions  where  there 

is  no  need,  and  failing  to  not  when  action  is  required. 

WHAT  DO  YOU  NEED? 


Data  requirements  and  availability:  News  clippings,  magazine  articles, 

speeches,  patents,  etc.  Utilizes  vhut  is  available. 

People,  Including  Organizational  Back-up:  Low  level  of  effort. 

Time : From  few  months  to  a continuing  nativity. 

Money:  Modest.  Corps  may  consider  organizing  their  existing  clipping  files 

and  Initiating  procedures  to  collect  items  from  personnel. 

Noise:  false  alums. 

Signals : Potential  breakthroughs. 
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FORECASTING  EVALUATION  FORM  f*l 


WHAT  IS  IT? 


Name  I PRECURSOR  EVENTS 

Deflnltlon/description:  A precursor  event  is  any  obaervable  event  or  devel- 
opment in  technology,  economy,  politics,  or  society  which  clearly  will  cause 
another,  subsequent  future  event.  EXAMPLE:  The  number  of  babies  born  in  the  U.S. 
in  1974  will  heavily  determine  the  number  of  20-year-old  Americans  in  the  year  1994 

History/degree  of  provenness/promlse:  As  a forecasting  method,  the  identi- 
fication and  analysis  of  precursor  events  haB  been  given  most  attention  by  tech- 
nological forecasters,  especially  military  forecasters  in  the  1950b  and  1960s. 

The  method  shows  great  promise  and  is  rather  well-proven  in  specific  instances, 
studied  in  retrospect. 

WHAT  DO  YOU  GET? 


Uses  and  limitations:  USES:  Where  they  can  be  identified  and  related  to 

phenomena  of  interest,  they  provide  an  early-warning  and  strategic  planning  tool. 
LIMITATIONS:  Outside  of  physical  technology,  identification  of  a precursor  event 
and  a solid  linkage  of  it  to  phenomena  of  interest  is  apt  to  be  difficult, 

Form(a)  of  Output:  A description  of  the  event  (actual  as  it  happens,  or 
theoretical— what  to  watch  fori,  together  with  an  explanation  of  how  it  ia  linked 
with  the  phenomena  of  interest,  and  the  probable  timing/ impact  of  the  event  on 
what  la  of  interest. 

Level  of  Detail:  In  technological  matters,  detail  may  be  rich,  exact.  In 

economic,  social  political  matters  the  description  is  more  apt  to  be  a fuzzy  image. 

Level  of  Confidence:  Highly  reliable  where  solid  and  well-known  cauae-effect 

mechanisms  are  present.  In  other  cases,  the  precursor  event  is  apt  to  be  limited 
in  utility  to  the  role  of  a supporting  indicator. 

Span  of  Forecast:  Dependent  on  the  time-frame  of  the  explanatory  mode.  EXAMPLE: 

Diffusion  of  a technological  innovation  in  general  1b  known  to  take  about  15  years. 
Thus  an  Innovation  today  may  have  implications  for  events  over  the  next  15  years. 

HOW  DO  YOU  DO  IT? 


Procedures:  Primarily  a matter  uf  literature  review,  personal  contacts  with 
informed  experts  in  fields  of  interest.  In  some  cases,  theoretic  predictive 
models  imply  or  suggest  precursor  events  to  search  for. 

WHAT  DO  YOU  NEED? 


Data  requirements  and  availability:  REQUIREMENTS:  One  needs  an  explanatory 
model  about  the  Inter-relations  among  events  of  interest,  identification  of  and 
access  to  pertinent  literature  end  experts,  and  analysts  experienced  in  the  field 
who  are  also  skilled  In  the  art  of  imaginative  yet  plausible  and  logical  con- 
jecture, AVAILABILITY:  Varies  widely  from  field  to  field— best  in  technology, 

worst  in  sociology. 

People,  Including  Orgnnl aational  Back-up:  At  least  one  qualified  analyst,  and 
access  to  pertinent  sources  of  literature  ar.d  information. 

Time:  Depends  on  the  scope  end  scale  of  the  topic  definition.  A quick  first 
pass  might  take  1 man-week.  A full-blown  program  for  a fairly  comprehensive  topic 
might  require  1 man-year,  or  even  more. 

Money : VarieB  with  scope  and  scale  of  effort — see  above. 
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FORECASTING  EVALUATION  FORM  » 1 


WHAT  IS  IT? 


Name!  ECONOMETRIC  FORECASTING 

Daflnltlon/deacr lotions  Basic  concept  la  that  a oerlea  of  aquationa  ia 
aavaloped  to  represent  tha  major  variablaa  in  the  economy  and  the  rela- 
tionships among  than  and  than  to  solve  them  simultaneously  to  obtain  a 
forecast  for  the  key  variables,  such  bs  GNP  and  consumer  spending. 

Hlstory/daarsa  of  provanness /promise t Wharton  School  of  Business.  Brookings 

Institute. 

Promise!  Corps  districts  can  subscribe  to  a forecasting  service,  such  as 
DRI,  to  get  economic  foracasta  rather  than  build  their  own  models.  Unless 
an  OCE  project,  hard  to  justify. 

WHAT  DO  YOU  GET? 


Usas  and  llal tat ions i Major  advantage  of  these  models  is  that  they  can  be  used 
for  simulating  anticipated  or  proposed  changes  in  monetary  or  fiscal  policy. 
Limitations!  Complax  and  expensive.  Compared  with  regression  analysis,  the 
extra  precision  gained  rarely  compensates  for  the  extra  coats  incurred  by 
its  use. 

Form(s)  of  Output;  quantitative  projections,  often  in  extensive  tabular  form. 

Level  of  Detail!  Generally  macroeconomics  dealing  with  major  accounts,  euch 
as  income,  consumption,  and  capital  spending. 

Level  of  Confidence!  High  as  the  extent  of  change  in  the  overall  economy  can 
become  the  input  required  to  estimate  other  variables. 

Span  of  Forecast!  Most  forecasts  are  for  2-3  years  or  less,  but  in  theory  can 
be  extended  indefinitely  ahead. 

HOW  DO  YOU  DO  IT? 


Procedures!  Yea.  Determine  the  functional  form  of  the  equations.  Estimate 
in  a simultaneous  manner  the  values  of  their  parameters.  Test  for  the 
ctatlstical  significance  of  the  resultB  and  the  validity  of  the  assumptions. 

WHAT  DO  YOU  NEED? 


Data  requirements  and  availability  I Detailed  data  requirements,  preferably 
historical  statistics  over  time  (data  banks) ; National  data  generally  more 
available  than  international  or  regional. 

People.  Including  Organisational  Back-uni  Technical  staff  backed  up  by  data 
bank  and  clarieal  facilities.  Programmer,  economists. 

Time:  Development  of  model  typically  takes  year  or  more;  most  computer  rum 

take  leas  time,  sometimes  only  minutes. 

Money : (including  facilities):  Tends  to  be  costly— for  data  acquisition, 

model  development,  computer  time,  and  technical  personnel. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 

Name;  DYNAMIC  MODELS 

Definition/ description i A study  of  the  feedback  characteristics  of  activity 
to  show  how  the  partB  Influence  the  success  of  the  enterprise. 

Determines  the  successive  relationships  of  key  factors  end  formulates 
mathematical  equations  to  describe  them. 

Histoty/daarae  of  provennasa/promisei  Developed  by  Jay  Forreater  in  the  early 
I9601 a 7 Extremely  controversial  but  acema  to  have  a great  degree  of  promise 
in  forecasting  and  feedback, 

WllAT  DO  YOU  GET? 


Uses  and  limitations;  Understand  interrelationships  among  internal  activities, 
as  dynamic  changes  from  the  environment  are  experienced.  Provides  an 
excellent  laboratory  for  experimenting  and  predicting  what  may  happen 
under  specific  circumstances . 

Limitations;  Extremely  complex.  Requires  much  data,  "easily"  suboptimised, 
and  often  difficult  to  quantify  some  variables. 

Form(s)  of  Output;  Graphs  of  changes  in  a Bet  of  variables  over  time. 

Level  of  Detail;  Aggregate. 

Level  of  Confidence;  High. 

Big  Question;  Can  simulation  of  really  large  systems  yield  aufflclent 
representation  to  be  reliable  guides  for  analysis  planning  end  decision- 
making. 

Span  of  Forecast;  Long-term, 

HOW  DO  YOU  DO  IT? 


Procedures;  Yes. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability ; Large  amounts  of  input  data. 

Computer  programs  (Designed  for  DYNAMO  compiler  but  adapted  to  more 
standard  systems.) 

People,  Including  Organizational  Back-up;  Large  group  of  people,  including 
analyat,  decision-makers,  programmers,  economists,  etc.  Also  nscssaary 
to  have  computer  facilities . 

Time;  6 months  to  1 year  and  up. 

Money ; Medium  to  high.  Running  costs  era  small,  but  development  costs 
are  high. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 


Name  STRUCTURAL  MODELS 

Deflnltion/dascription:  "Models  that  attempt  to  explain  growth  in  terms  of 

structural  variables,  but  which  are  not  restricted  to  attempting  to 
justify  certain  observed  behavior." 

History/degree  of  provenness/promlsei  Model  developed  by  Planning  Research 
Corporation  ior  the  Flight  Dynamics  Laboratory  of  the  U.S,  Air  Force 
(Ordered  "Techniques  fur  Predicting  R&D  Costa..,"  AD  607283).  Economic 
models  may  be  of  more  interest  to  Corps. 


WHAT  DO  YOU  0ET7 


Uses  and  limitations i This  specific  example  refers  to  forecasting  the  time 
and  costs  required  for  a given  project  intended  to  produce  an  advance 
in  technology, 

Limitations i Errors  in  determining  coefficients  (same  as  econometric 
models)  and  same  limitations  as  trend  extrapolation:  no  reason  always 
to  expect  that  the  future  will  continue  in  the  same  trends  as  the  past. 

Form(s)  of  Output:  Time  series  of  costs  and  time  required  to  complete 

development  of  a specific  advance  in  technology. 

level  of  Detail:  Detailed. 

Level  of  Confidence:  Predictive  power  nuty  be  very  weak;  however,  forecaster's 

"""degree  of  confidence  can  be  much  higher,  since  the  relationship  found  is 
based  on  more  than  just  coincidence. 


Span  of  Forecast:  Determined  by  technology  and  need  probably  Isas  than  20  years. 

HOW  DO  YOU  DO  IT? 


Procedures : 

A.  Determine  necessary  set  of  functions 
Determine  costs  to  be  Included 
Determine  starting  & ending  times 

B.  Determine  characteristics  of  technology 

WHAT  DO  YOU  NEED? 


1.  Establish  ground  rules 

2.  Determine  characteristics 

3.  Collect  data  and  review 

4.  Set  up  regression  model 


Data  requirements  and  availability  I Consistent  historical  data  necessary 
(or  regression  analysis) . Need  procedures  to  "standardise  data." 


People.  Including  Organisational  Back-up i Data  analyst.  Cost  analyst. 
Mathematician,  and  programmer.  Also  computer  backup. 

Time:  Detailed  analysis  could  require  a year  (guest) 


Money i Medium  to  high. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 

Name!  DECISION  THEORY  (Bee  aleo  sheet  on  DECISION  MATRIXES) 

Deflnitlon/descriptloni  Refers  to  a large,  varied,  rapidly  expanding  body  of 
basic  and  applied  theory  relating  to  processes  for  naking  a variety  of  types 
of  decisions  under  nany  types  and  degrees  of  uncertainty.  Stresses  rational 
choices  under  constraints  of  psychological,  social,  political,  economic  factors, 
as  well  as  imperfect  information. 

Hlstory/dearee  of  provenness/proalso;  Decision  theory  evolved  originally  out 
of  earlier  work  in  operations  research  during  the  World  War  II  period.  Decision 
theory  tends  to  focus  on  situations  whose  complexity  and  uncertainty  places  them 
beyond  reach  of  OR.  Widely  used  in  defense,  high-technology  environments. 

WHAT  DO  YOU  GET? 

Ubbb  and  limitations;  USES:  Steiner  suggests  that  decision  theory  1b  used  in 
systems  analysis,  systems  engineering,  systems  management,  and  project  manage- 
ment. In  each  of  these,  decision  theory  can  be  applied  respectively  to  forecast 
requirements,  spscif icatlons,  designs,  and  execution  tasks. 

Fora(s)  of  Output:  Many  and  varied,  depending  on  nature,  scope,  and  detail  of 
application.  May  take  the  form  of  a set  of  linear  equations  embodying  the 
critical  variables,  may  be  realized  as  an  operating  computer  simulation  model,  etc. 

Level  of  Detail:  Decision  theory  may  be  applied  at  nearly  every  level  of 
generality  or  detail,  depending  on  available  information,  number  and  variety 
of  tenable  assumptions,  insights  into  the  pertinent  topics,  etc. 

Level  of  Confidence:  Decision  theory  is  typically  invoked  where  complexity, 
costa,  risks,  and  potential  benefits  are  large  and/or  critical.  In  such 
situations,  heavy  reliance  may  necessarily  be  placed  on  the  methods  used,  as 
decision-makere  may  have  little  or  no  confidence  in  their  own  intuitive  judgments. 

Span  of  Forecast:  From  a few  months  to  several  years,  or  even  longer  in 
some  caseB  (environmental  impacts,  for  example) 

HOW  DO  YOU  DO  IT? 

Procedures:  DECISION  MATRIXES  (for  which  see  separate  sheet)  are  one  simpler, 
more  obvious  example.  An  extensive,  rich  body  of  work  exists  which  can  be 
applied  according  to  approaches  and  problem  requirements. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability:  Appropriate  empirical  data  pertinent  to  the 
problem  or  situation,  plus  pertinent  models,  formulae,  etc.,  for  application. 
People,  Including  Organizational  Back-up;  Decision  theory  is  a sophisticated 
field  emphasizing  advanced  umerical,  statistical  and  other  quantitative  tech- 
niques. Trained  and  skilled  analysts  are  required,  and  the  sponsor's  sophisti- 
cation must  be  commensurate  If  results  are  to  be  comprehensible  and  useful. 

Time:  Simple  applications  might  o ;e  i few  mar  weeks  to  a month.  Large-scale 

projects  might  require  a year  or  more  ari  Beveral  man-years. 

Mrney : Varies  greatly— Bee  above. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 

Name  MORPHOLOGICAL  MODELLING 

Definition/description:  Might  also  be  called  structural  modelling.  A eye ten  or 
technological  challenge  is  broken  down  Into  many  email  component  function!  or 
requirement!.  For  each  functional  requirement,  conjecture  or  brainitormlng  1b 
employed  to  generate  a number  of  actual  or  conceivable  aolutlone.  Overall 
solutlone  of  many  sorts  are  then  developed  by  combining  various  sub-component 
solutions , 

History/degree  of  provenneee/promlsei  Morphological  modelling  wee  devised  end 
developed  in  the  1950a  and  1960a  by  the  late  Fritz  Zwicky,  who  demonstrated  its 
potential  especially  in  the  field  of  aerospace  technology.  The  approach 

has  been  widely  dlecuesad  and  experimented  with. 

WHAT  DO  YOU  GET? 

Uses  and  limitations!  USES:  F.nablae  users  to  estimate  the  range  and  diversity  of 
future  potential  solutions  for  technological  challenges,  compares  and  contrasts 
an  extensive  list  of  possibilities  which  may  lead  to  fruitful  R6D.  LIMITS: 

Depends  on  the  analyst's  knowledge  of  the  problem,  understanding  of  pertinent 
technology  and  powara  of  conjectural  imagination. 

Forn(s)  of  Output:  Yields  morphological  diagrams  which  amount  to  detailed  func- 
tional analysis  of  system  or  problem  requirements,  Integrated  with  "mape"  of 
potentially  pertinent  technology,  plus  backup  documentation  often  in  rich  detail. 

Level  of  Detail:  Morphological  diagrams  provides  integrative  overview  of  proepecta 
plue  organised  entry  key  to  pertinent  reeeirch  literature.  Amount,  richneaa  of 
detail  ie  limited  only  by  atate-of-art  of  pertinent  technologiea. 

Level  of  Confidence:  Morphological  modelling  is  more  an  exploration  of  what 
could  be  done  than  it  la  a forecast  of  what  will  be  done. 

Span  of  Forecast : Esaentinlly  time-free,  in  that  it  looks  nt  functional 
structures  without  estimating  how  much  effort  for  how  long  may  be  required 
to  realize  a given  pnssibtl  lty,  although  of  course  this  estimate  can  be  made 
separately. 

HOW  DO  YOU  DO  IT? 

Procedures : 1.  Identify/def inu  a system  or  problem  whose  future  resolution  prospects 
are  to  be  examined.  2.  Make  an  analytic  structure  which  maps  the  micro-function* 
entailed.  3.  Identify  every  conceivable  technological  approach  pertinent  to  each 
micro-function.  4.  Map  every  plausible  combination  of  sppruachos  which  might  solve 
the  problem.  5. Select  on  some  basis  those  approaches  which  neem  most  promising. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability:  Requires  detailed  analysis  of  system*  or  pro- 
blems to  be  studied,  comparable  descriptions  of  a wide  range  of  technologies.  The 
availability  of  these  or  the  feasibility  of  developing  them  varies  widely  from 
one  problem  to  another. 

People,  Including  Organizational  Back-up:  An  analyBt  experienced  in  the  method 
and  an  analyst  richly  experienced  with  pertinent  technologies. 

Time:  For  all  but  the  smallest  approaches,  a re-iterative  effort  occupying  an 
interval  of  many  weeks  or  months  Is  necessary  for  adequate  treatment. 

Honey : Several  thousand  to  tens  of  thousands  of  dollars. 
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WHAT  IS  IT? 


Name;  DECISION  MATRIXES  (MATRICES)  (Vertical/horizontal) 

peflnitlon/dsscrltPtloni  A basic  method  in  applied  decision  theory.  When  two 
basic  kinds  of  factors  (e.g.  resources  vs  requirements)  are  crucial,  a two- 
dimensional  decision  table  is  used.  When  three  kinds  of  factors  ere  crucial,  a 
three-dimensional  cube  is  employed.  A variety  of  qualitative  and  quantitative 
procedures  are  used  to  specify  each  inter-relationship  among  all  the  factors 
considered. 

History/dearae  of  orovennsss/promlse;  The  theory  and  use  of  decision  matrixes 
has  bean  developed  as  an  aspect  of  applied  decision  theory  primarily  during  tha 
1960s  and  1970s,  by  DOD,  in  computer  aciencas,  and  in  businaas  mgt  reaearch. 

They  are  widely  used. 

WHAT  DO  YOU  GET? 

Usee  and  limitations!  USES:  An  axplicit,  systematic,  comprehensive  consideration 
of  many  interrelationships  involved  in  particular  decisions  or  kinds  of  decisions. 
LIMITATIONS:  Horizontal  matrixes  (interaction  among  factors  at  one  level  of 
generality)  are  relatively  well  developed  but  vertical  matrixes  are  more  primitive 
because  it  is  more  difficult  to  estimatc/quantify/specify  relationships  between 
different  levels  of  detail. 

Form(a)  of  Output:  Matrix/table  liata  types  and  examples  of  factors  considered, 
together  with  values  for  each  cell,  supported  by  data  and  estimating  procedures 
used  to  arrive  at  values. 

Level  of  Detail:  Detail  level  quite  varied.  Depending  on  breadth/preciaion  of 
decisions  analyzed,  nature  of  factors  considered,  data  available,  quite 
detailed  matrix  sets  are  feasible. 

Level  of  Confidence:  Varies  widely,  because  the  method  1b  applicable  over  a 
wide  range  of  decisions  for  which  structure/uncertainty  may  vary  widely. 

Span  of  Forecast:  Forecasting  is  only  one  application  of  a decision  matrix. 

In  that  application,  the  forecast  horizon  may  he  "date.leHu"  (decision  sequence 
considered  apart  from  time  interval  required  for  each  item)  or  date  by  cumu- 
lative estimate  of  times  required  to  complete  each  step  in  sequence. 

HOW  DO  YOU  DO  IT? 

Procedures:  1.  Identify/define  decision  or  type  of  decision.  2.  Identify/define 
typua/pnrticulars  of  pertinent  factors.  Array  typeH  of  factors  against  each 
other  in  a matrix.  3.  Select/devolop  procedures  for  describing/aaseasing  rela- 
tionships between  each  factor  and  all  others.  A.  Make  overall  assessment. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability:  Data  charucte.rlzing/dcf ining  each  of  the 
factors,  specified  procedures  For  manipulating  the  data.  AVAILABILITY : Varies 
widely,  dependent  upon  nature/explicitness  of  factor  variables. 

People.  Including  Organizational  Back-up:  Persons  experienced  in  decision 
matrix  techniques,  persons  experienced/understanding  types  of  decisions  to 
be  made  for  particular  purposes. 

Time:  Varies  widely,  from  a few  man-days  for  simplo  matrices  for  which  factors 
are  defined/few  and  data  is  readily  accessible — to  many  man-months  or  even 
man-years  for  Iohs  structured  more  ambitious  problems. 

Money:  Varies  great ly— see  above 


1 


17 


1 

i 


FORECASTING  EVALUATION  FORM  III 

WHAT  IS  IT? 

Name;  RELEVANCE  TREES  (Vertical  r.nd  Horizontal) 

Definition/ description;  A systematic  decision-making  aid  in  which  weighted 
indexes  based  on  consensus  expert  judgment  are  used  to  indicate  how  closely 
ralatad  (relevant)  given  technological  capabilities  are  to  specified  needs. 

Needs  may  be  specified  generally  (e.g.  nationally)  or  at  on  or  more  levels  of 
successive  detail,  with  relevance  index  numbers  assigned  at  each  level. 

Hlstorv/desree  of  provenness /promise;  Minneapolis-Honeywell  1b  the  acknowledged 
developer  and  user  of  this  approach,  using  its  so-called  PATTERN  method.  Honeywell 
reports  results. 

WHAT  DO  YOU  CET7 

Usss  and  limitations i USES;  Provides  best-judgment  rank-order  of  pertinence 
Tor  given  technological  developments,  either  at  various  levulB  of  generality 
(vertical  relevance)  or  across  several  sectors  of  activity,  such  as  various 
military  services  within  Department  of  Defense  (horizontal  relevance). 

Forra(s)  of  Output;  Graphic  relevance  tree  diagram,  showing  the  technological 

capability  analyzed,  together  with  the  names  of  the  levels  or  sectors  for 

which  relevance  Index  numbers  have  been  estimated,  and  the  index  numbers  themselves. 

Laval  of  Detail;  Actual  relevance  tree  proper  ehows  little  detail.  However, 
backup  documentation  on  tha  basis  of  which  relevance  index  numbers  are  assigned 
may  ba  quite  detailed, 

Level  of  Confidence;  VarieB  widely.  Cen  be  accepted  with  much  confidence  if 
the  technology  ia  sufficiently  well  identified,  potential  applications  are 
well  identified,  and  needa  priorities  for  potential  applications  can  be 
•etlmatad  with  confidence. 

Span  of  Forecast;  Dependent  upon  the  formal  forecasting  time  horizons  used  by 
organisations  maintaining  formal  needs  assessments  programs. 

HOW  DO  YOU  DO  IT? 

Procedures;  1.  Identify  specific  needs.  2.  Identify  range  of  potential  technological 
developments  which  might  meet  need,  3.  Identify/uccess  panel  of  experts  able  to 
judge  how  well  each  technology  might  satisfy  each  need  after  proper  development. 

4,  Facilitate  consensus  of  Judgment  by  experts  in  the  form  of  relevance  index 
numbers  for  each  level  or  sector  of  needs /applications  analyzed, 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability!  REQUIREMENTS;  Fairly  well  organized,  formalized,  j 

and  explicit  statements  of  need.  Fairly  well  identified  list  of  prospective 
technological  developments  which  can  be  reasonably  matched  to  needs  by  qualified 

experts.  LIMITS:  Designed  for  DOD  environment;  requirements  may  be  less  available  j 

in  other  settings, 

People.  Including  Organizational  Back-up;  Requires  persons  well  informed  about 
speoific  mission  needs  and  about  prospective  applicable  technologies.  Implies 
fairly  large,  well-organized,  sophisticated  staffs, 

Time;  Developea  to  any  minimally  useful  level,  relevance  trees  require  a few 
months  to  complete  and  a minimum  of  a few  man-months  of  expert  talent. 

Money;  Relatively  expensive  (minimum  tens  nf  thousands  of  dollars)  for  any 
minimally  useful  output. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 

Name;  Analysis  of  'Theoretical  Limits  and  Barriers  to  Technological  Advance 

Definition/description;  A subjective  conjectural  method  mentioned  as  being 
of  interest  in  a March/April  1967  issue  of  Harvard  Business  Review  by  James 
Brian  Quinn. 

History/degree  of  provenness/pronlse;  More  a mentioned  possibility  than 
a systematically  developed  methodology. 

WHAT  DO  YOU  GET? 

Uses  and  limitations;  USES:  Enables  one  to  conjecture  about  the  future  impact 
of  a newly  Introduced  technology.  LIMITATIONS;  In  the  absence  of  clear 
demand  forecasts,  conjecture  about  a new  technology's  impacts  partakes  of 
the  flavor  of  science  fiction. 

Fonn(g)  of  Output;  Narrative  conjecture  or  imaginative  projection  of 
trends  of  one  form  or  another. 

Level  of  Detail1.  Detail  may  be  bb  rich  (and  misleading)  as  the  user's 
imagination  permits. 

Level  of  Confidence;  Little  confidence  can  be  placed  in  the  notion  in  its 
current  state  of  non-development.  Its  utility  is  more  to  stimulate  the 
imagination  about  possibilities  than  to  forecast  actual  future  developments. 

Span  of  Forecast;  As  far  ahead  as  the  user  cares  to  conjecture. 

HOW  00  YOU  DO  IT? 

Procedures;  1.  Identify  and  describe  the  new  technological  innovation. 

~2.  Conjecture  about  its  potential  future  applications.  3.  On  the  basiB  of 
2),  estimate  its  impact  on  existing  technology,  commerce,  etc. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability:  A newly-made  technological  innovation 

and  a well-informed,  active  imagination. 

People.  Including  Organizational  Back-up:  see  above 

Time;  for  serious  forecaating  purposes,  little  time  or  effort  can  be  justified. 
\s  an  opening  sequence  prior  to  serious  forecasting,  a group  might  very 
profitably  employ  this  technique  as  the  basis  for  one  or  a few  brainstorming 
sessions. 


Mqnejr;  Very  little  investment  is  justified  or  required. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 

Name:  ANALYSIS  OF  INDUSTRIAL  BEHAVIOR 

Daflnltlon/deacriptioni  Industrial  classified  as  either  cob t-mlnimi zing, 
sales  maximizing,  or  performance  maximizing.  For  the  latter  (the  science/ 
technology  Industries),  the  thesis  is  applied  that  the  size  of  the  industry's 
largest  plant  tends  to  proceed  in  stepwise  fashion  with  market  growth,  other 
things  being  equal,  and  the  state  of  the  business  cycle  permitting.  Appli- 
cation of  thesis  enables  predictions  about  industry  behavior/ trends. 

History/degree  of  provenness/promlsa;  The  industry-typology  thesis  was  advanced 
by  Ayars  in  1969,  and  extended  and  applied  in  this  case  by  W.H.  Clive  Simmons, 
formerly  of  Canadian  Industries,  during  the  early  70s.  These  seem  to  be 
supported  by  retrospective  data  examined  by  Simmons. 

WHAT  DO  YOU  GET? 

Uses  and  limitations;  USES!  Enables  investors,  industry  autpliers,  top  manage- 
ments contemplating  plant  investment  to  have  some  plausible  baala  for  pre- 
dicting near-term  trends  within  performance  maximizing  industries,  e.g. 
aerospace,  computer,  defense,  electronics  industries.  LIMITATIONS:  Predictive 
validity  not  proven. 

Forni(s)  of  Output:  Nuoerical/graphie  data  which  trace  past  trends  in  plant 
size  expansion/related  impacts,  enable  projections  of  future  trends. 

Level  of  Detail!  Indus  try- level  at  best,  detail  most  needed  for  specific 
decisions  may  often  be  lacking. 

Level  of  Confidence!  Limited  by  virtue  of  limited  experience.  Replicable 
rerulta  by  critics,  successful  forecaats  made  by  others  with  the  method 
may  in  time  increase  confidence  in  the  method. 

Spen  of  Forecast!  Historic  date  extends  backwards  over  many  yeara.  Data  may 
be  projected  forward  aa  many  yeara  as  is  desired.  Presumably,  confidence  in 
projections  would  not  extend  much  beyond  average  plant  lifespan  in  a given 
industry. 

HOW  DO  YOU  DO  IT? 

Procedures:  1.  Identify  end  define  a specific  performance-maximizing  industry. 
2.  Gather  and  plot  history  of  datc-of-opening  of  industry's  largest  plants, 
year  by  year.  3.  Relate  plant-opening  history  to  details  of  past  business 
cycles.  4.  Project  business  cycle  for  future.  5.  Project  related  plant- 
opening forecasts  by  date. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability:  Cl*ar,  definite  data  on  consistent  basin 
shoving  history  of  opening  of  the  largest  plants  in  a clearly  defined  Industry. 
Raw  Information  is  available  in  most  cases,  but  logical  aggregation  flml 
interpretation  or.  a coherent  basis  may  be  difficult  if  industry  definition 
is  Inadequate. 

People,  Including  Organizational  Back-up:  Business  analysts  famt  ' ir  with 
the  industry  under  study. 

Time : Gatlicring/interprctutlon  of  data  will  require  ut  least  a 1 cw  r.\.  in-weeks 
and  could  require  a few  man-years  if  the  scale/detall/scnpe  of  the  analysis 
Is  elaborate  enough, 
itcv  ! Varies- -see  above 
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WHAT  IS  IT? 

Name:  TECHNOLOGICAL  AUDIT 

Def lnitlon/deseriptlon:  A special  application  of  Delphi  method,  used  by 
Minneapolls-Honeywall  as  an  input  to  its  long-range  research  planning.  A 
Delphi  poll  focussed  on  future  technological  events  having  import  for 
Honeywell  profits  was  made  among  divisional  market/engineering  people, 
corporate  research  scientists,  and  corporate  managers. 

History /degree  of  provanness /promise i Honeywell  reports  in  this  application 
mad*  in  1967-1968  that  the  four-round  poll  attained  useful  clarification 
and  consensus  as  to  Honeywell  research  priorities,  on  the  basis  of  pre- 
determined selection  criteria. 

WHAT  DO  YOU  GET? 

Uses  and  limitations!  USES!  A selection  criterion  in  allocation  of  talent 
and  funds  for  research,  plus  a technological  forecast  focussed  on  company- 
specific  sectors  of  technology.  LIMITATIONS:  All  the  limitations  of  Delphi! 
time-consuming,  panel  makeup  may  distort  results,  relies  on  subjective 
Judgment,  etc. 

Form(a)  of  Output!  Lists  or  tables  of  research  priorities  associated  with 
panel-weighted  Judgments  which  enable  rank-ordering  of  priority  selections, 
within  a division  or  across  divisions. 

Level  of  Detail!  The  immediate  detgil  gained  in  four  rounds  was  relatively 
limited.  However,  since  the  forecast  wsb  conducted  among  known  persons  within 
the  company,  detail  in  whatever  depth  desired  was  always  accessible. 

level  of  Confidence!  Conductors  of  the  effort  seem  to  feal  that  the  results 
obtained  were  another  useful  contribution  to  research  planning,  rather  than 
an  extension  or  replacement  of  methods  already  in  use. 

Span  of  Forecast!  Ten  years-1967-1977  (Date  of  forecast  span  now  makes  it 
feasible  for  Honeywell  to  check  validity  of  forecast  results) 

HOW  DO  YOU  DO  IT? 

Procedures!  Four-round  Delphi  poll  (for  which  see  DELPHI  sheet),  followed 
up  a year  later  by  field  interviews  in  depth  with  selected  panel  members. 

WHAT  DO  YOU  NEED? 


Data  requirements  and  availability!  Data  ami  judgments  in  the  possession  of 
accessible  and  nominally  qualified  experts.  In  Honeywell's  case,  these  con- 
ditions were  satisfied  by  personnel  resources  and  top-management  decision 
to  make  the  Btudy. 

People.  Including  Organizational  Bnck-upi  see  above 

Time!  Source  not  specific.  Initial  Delphi  prnbab.lv  was  made  within  a single 
12-aonth  period.  Field  interviews  were  conducted  a year  lator,  and  may  have 
taken  several  weeks  to  a few  months. 

Money : Company  does  not  report  estimated  cost,  which  in  any  '-.mo  came  out 
of  general  management  operating  budget. 


FORECASTING  EVALUATION  FORM  #1 

WHAT  IS  IT? 

fjSai  SOCIAL  TREND  ANALYSIS 

Otflnitlon/descrlptloni  Any  of  a variety  of  procedures  for  identifying,  apeci- 
fylng  and  intsrpratlng  qontinuitiea , dlacontinulclaa,  and  changa  rataa  for  any 
number  of  apaclfic  phenomana  related  to  aueh  mattara  aa  health,  education, 
welfare,  demography,  income,  etc. 

Hiatory/dearee  of  provanntas/promlaai  The  effort  to  collect,  etandardlce,  and 
update  statistical  and  other  data  about  aocletal  tranda  ia  at  leaat  200  yearn 
old,  and  van  In  fact  the  origin  of  intaraat  in  atatiatica.  Analytes  accepted 
aa  valid  are  restricted  rather  narrowly,  with  population  trends  perhaps  most 
generally  regarded  aa  validly  analyaabla. 

WHAT  DO  YOU  GET? 

Uaaa  and  limitations t USESt  Syitematic  inalghta  into  given  trends  or  into 
interrelationships  among  trends  may  yield  useful  forewarnings  of  emergent  pro- 
blems and  developing  opportunities,  from  the  perspective  of  any  given  organisa- 
tion. LIMITATIONSi  Serious  data  problems  (aee  below),  plus  weak  or  non-existent 
theories  about  proceaaea  of  social  change. 

form(e)  of  Output i Typically,  selected  time  aeries  data  in  graphic  profile  form, 
accompanied  by  analytic/intarpretative  narratives.  The  Office  of  Management  and 
Budget  publication,  SOCIAL  INDICATORS  (1973)  la  the  current  standard  source. 

Level  of  Detail:  Usually  gross  and  general  relative  to  the  phenomenon  of 
Interest.  Development  of  detail  is  sometimes  possible,  but  usually  only  at 
great  expanse  and  rapidly  declining  confidence  as  detail  increases. 

Level  of  Confidence!  At  best,  confidence  is  quite  high.  EXAMPLE!  Work  fores 
projections  for  given  future  years ■ based  on  present  population  plus  current 
birth  rates.  At  worst,  no  confidence  at  all.  EXAMPLE)  Status  of  organised 
religions  15  years  hence. 

Span  of  Forecast!  Can  be  any  time  span.  For  many  phenomena  there  la  an 
apparent  or  presumed  cine  cycle  which  Imposes  a natural  forecast  span.  EXAMPLE! 
Average  lifespan  determines  a natural  apan  for  forecasting  sga-cohort  shifts. 

HOW  DO  YOU  DO  IT? 

Procedures!  1.  Identify  intendod  uses  of  analysis.  2.  Identify/define  social 
trends  of  Interest.  3.  Identify/compile/assnss  pertinent  timo-eeriea  data, 
other  information.  4.  Integrete/corrclate  pertinent  seta  of  time-aeriea  data. 

5.  Interpret  relation  of  time-series  data  trends  to  social  tronds  of  interest. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability!  REQUIREMENTS:  Standardised  multi-year  time 
scries  data  which  demonstrably  or  at  least  plausibly  reflects — hopefully 
antic ipates—signif leant  changes  in  direction  or  rate  of  development  of  societal 
trends  of  interest. AVAILABILITY!  Very  poor.  Most  existing  data  represent :i  INPUT 
measures  while  most  significant  measures  are  OUTPUT  measures.  EXAMPLE  It's  not 
what  ia  epent  on  education  which  determines  changes  in  quality  or  .i r i a I nmen t 
levels  in  education. 

People,  Including  Organizational  Bnck-up:  Qualified  social  mc i .■  :i i uln  experienced 
in  phenomena  of  interests  and  in  development  and  ubp  of  stutisi  1 . a 1 timo-scrlpe 
men™  remen  ts. 

Time;  If  existing  indicators  arc  available  and  acceptable,  preliminary  inter- 
pretations for  given  purposes  i».-iy  require  only  a few  days,  At  the  other  extreme, 
n inv  man-months  nr  even  mun-yi-. .rn  may  he  required. 

Monevi  Varies  greatly — floe  .limve. 


FORECASTING  EVALUATION  FORM  11 1 


WHAT  IS  IT? 

NOTH  I SCENARIO-WRITING 

Definition/daactiptlon;  Literary,  numerical,  and/or  graphic  narratlvea  which 
describe  and/or  explore  the  implications  of  future  sequences  of  events  and 
states  of  affairs,  givan  some  specified  topic  and  toms  set  of  explicit  or 
implicit  promises. 

History/daaree  of  provenneas/promisei  In  literary  form  this  represents  one  of 
the  oldest,  most  widely  practiced  methods  of  conjecturing  about  possible 
futures.  Including  utopian  literature,  science  fiction,  etc.  The  approach 
is  more  useful  for  interpreting  forecasts  or  stimulating  the  imagination  than 
it  is  for  making  firm,  rigorous  forecasts. 

WHAT  DO  YOU  GET? 

Uses  and  limitations t USESt  Excellent  for  integrating  a number  of  isolated 
and  diverse  specific  projections  and/or  predictions,  so  that  the  user  acquires  a 
"feel"  for  the  overall  future  Btate  address  by  each  isolated  projection. 
LIMITATIONS } Much  is  implicit,  ambiguous,  and  not  necessarily  supported  by 
specific,  reliable,  valid  forecasts. 

Form(a)  of  Output!  Narratives,  graphs,  illustrations,  films,  interactive 
computer  displays,  other. 

Level  of  Detail 1 Depends  on  intended  users  and  intended  objectives.  May  be 
limited  to  particular  details  available  from  individual  forecasts,  or  may 
incorporate  inferential  higher-order  relationships  in  order  to  Integrate  isolated 
predictions  into  a coherent  "story."  Much  usually  is  plausible  but  not  neces- 
sarily predicted. 

Level  of  Confeance;  Depends  on  scope,  nature  of  topic.  Where  the  scenario 
represents  a plan  believed  to  be  well  within  the  capacity  of  the  scenario- 
writing organisation,  much  confidence  may  be  placed  in  it. 

Span  of  Forecast;  Unlimited  range,  subject  to  users  requirement  for  detail, 
validity,  etc. 

HOW  DO  YOU  DO  IT? 

Procedures}  1.  Specific  topic  of  scenario  in  some  detail.  2.  Identify  and 
reconcile  a set  of  explicit  premises  on  which  to  base  the  scenario.  3.  In  one 
or  more  subjective  drafts  reviewed  by  critics  including  users,  develop/extend/ 
refine  scenario. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability;  REQUIREMENTS!  Clear  sense  of  who  the  user 
is,  what  the  topic  is,  and  Intended  uses  of  the  scenario.  Large  fund  of  data, 
information,  ideas  pertinent  to  the  topic.  Persons  skilled  in  scenario  develop- 
ment working  in  concert  with  persons  expert  in  the  subject  matter.  AVAILABILITY: 
Depends  on  topic,  user  needs, 

People.  Including  Organisational  Back-up;  Requires  people  able  to  devise  re- 
latively smooth  and  plauaiblc  accounts  in  rich  detail  dependent  upon  scattered, 
disparate,  discontinuous  individual  forecasts.  User  must  have  sure  sense  of 
requirements,  willingness/ ability  to  offer  constructive  criticism  as  drafting 
proceeds. 

Time;  If  user  need!?  and  raw  information  are  available,  first  draft  scenario  can  be 
done  in  a few  days  or  weeks  by  experienced  persons.  Effort  may  require  much  longer. 
Money;  Requires  u few  man-weeks  to  a few  man-years,  and  typically  s few  man- 
months  if  a SET  of  scenarios  exploring  given  topics  on  the  basis  of  alternative 
sets  of  premises  is  required,  as  is  often  necessary  for  optimum  utility. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 

Hum  CANONICAL  TREND  VARIATION  (ace  alao  SURPRISE-FREE  PROJECTIONS) 

Daflnlt Ion/ description:  A att  of  surpriaa-frea  projections  la  uaad  to  davalop 
an  arbitrary,  eoncraatlva  aat  of  "atandard  worlda,"  or  dlffarant  potantlal 
futuraa  for  a givan  topic.  By  altarlng  baalc  aaauaptlona  for  ona  ot  aora 
projactlona  (a.g.  aaauaptlona  about  futura  birth  rataa),  ona  davalopa  cor- 
raapondlngly  dlffarant  "atandard  worlda".  Alteration  of  aaauaptlona  with 
corraaponding  outputa  ara  called  canonical  trend  varlatlona. 

Hlatory/daaraa  of  provannaaa/proaleai  Rahn-Welnar  devalopad  thla  method  aa 
published  in  thalr  book  THE  YEAR  2000  in  1967.  Their  concept  la  often  cited 
and  eoaetlaea  applied  by  othara. 

WHAT  DO  YOU  GET? 

eataggasmi  u ,isa 

Uaaa  and  limitations!  USES  I Provldaa  an  explicit,  ayataaatlc  aat  of  contraatlve 
"atandard  worlda11  exploring  a aat  of  variable  potential  futuraa  for  the  topic. 

LIMITATIONS!  Canonical  Trend  Variation!,  Ilka  aurprlae-free  projactlona,  ara 
NOT  prediction!  or  foracaata,  merely  useful  tools  for  intelligent  conjecture. 

Form (a)  of  Output!  Graphic,  numerical,  or  verbal  characterisations  of  dlffarant 
potantlal  "standard  worlda"  for  a given  topic. 

Laval  of  Detail!  Initial  Canonical  Trand  Variations  are  typically  groas  and 
simple.  Detail  can  be  added  progreaaively  aa  new  information  ia  diacovared 
or  incorporated,  and  aa  specific  iaauea  requiring  atudy  arise. 

Laval  of  Confidence!  Confidence  levels  do  not  pertain,  because  Canonical 
Trand  Variations  as  such  ara  NOT  regarded  aa  predlctiona  or  foracaata. 

Span  of  Forecast!  Any  time-span  daalred. 

mMMMM1  ' 

Procedure* i 1.  Select  a act  of  surprise-free  projections  pertinent  to  topic. 

2.  Acquire  data  information  describing  tha  pertinent  projactlona.  3.  Ona  by 
one,  vary  the  seta  of  assumptions  made  about  future  rates  of  changa/stabllity 
in  the  trends.  3.  Develop  individual  canonical  trend  variation  using  each  of 
the  dlffarant  seta  of  assumptions  with  the  same  trend  data. 

Data  requirements  and  availability!  One  needs  an  adequate  topic  definition, 
identification  of  topic-pertinent  trends,  data  which  describe  the  trends. 

Availability  depends  on  the  nature  of  the  topic  and  the  amount  of  detail  sought. 

People,  Including  Organisational  Back-up!  Analysts  must  be  experienced  with 
respect  to  topic,  know  and  have  access  to  appropriate  data  sources,  be  able 
to  judge  and  state  critical  assumptions,  be  able  to  systematically  vary  stated 
assumptions,  and  to  manipulate  data/ information  accordingly. 

Time i Varies  greatly,  depending  on  scope,  nature  of  topic,  amount  of  information 
included  in  base.  Can  be  one  man-day  to  ono  or  more  man-months. 

Money!  Varies  greatly— see  above. 
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FORECASTING  EVALUATION  FORM  #1 

WHAT  IS  IT? 

Name  i SURPRISE-FREE  PROJECTION'S  (see  also  Canonical  Trend  Variation) 

Deflnltlon/descrlptlon:  Kahn-Wainer,  the  deviaera  of  thia  method,  atate: 

"One  can  think  of  a aurpriae-free  projection  aa  being  aa  eophieticated  a 
projection  as  it  seemi  reasonable  to  make  given  the  available  understanding 
of  current  trends. ..there  la  no  implication  that  a aurpriae-free  projection 
ia  likely." 

Hiatory/dearee  of  provennesa/promlae;  In  a general  sense,  demographers,  econo- 
mists, and  many  other  professionals  have  long  made  uae  of  projactiona  of  the 
present  into  the  future  IF  PRESENT  TRENDS  PERSIST.  Such  projections— which 
to  repeat  are  NOT  forecasts— serve  as  a useful  comparison  standard  for  actual 
predictions. 

WHAT  DO  YOU  GET? 

Uses  and  limitations)  USESi  Projacte  a "standard"  and/or  "surprise-free"  future 
which  Jerves  as  a reference  for  investigating  the  timing  and  impacts  of  any  one 
or  more  "surprises"  one  might  conceive  of  pertinent  to  his  forecast  topic. 
LIMITATIONS:  Arbitrary  aelection  of  trends  judged  pertinent  to  topic. 

Sometimes,  data  may  be  unavailable  or  of  suspicious  quality. 

Form(a)  of  Output:  Many  examples  are  seen  in  Kahn-Wainer ' a The  Year  2000, 
consisting  of  linear  projections,  tables  of  data,  and  contrastive  lists  of 
bl-modal  trands. 

Level  of  Detail:  Depends  on  the  level-of-detail  of  data  used,  plus  the  nature 
of  the  topic.  Kahn-Weiner,  for  example,  project  "worlds"  which  means  a very 
gross  level  of  detail,  If  one  projected  "surprise-free"  budgets  for  the  Corps, 
much  more  detail  could  be  provided. 

Level  of  Confidence:  Since  surprise-free  projections  are  not  intended  to  be 
accepted  as  forecasts  in  and  of  themselveB,  confidence  levals  do  not  pertain. 

Span  of  Forecast:  May  be  whatever  time-span  the  analyst  selects. 

HOW  DO  YOU  DO  IT? 

Procedures:  1.  Specify  the  projection  topic  carefully.  2.  Assemble  time-aeries 
and/or  other  data  to  be  used.  3.  Develop  explicit  assumptions  sbout  projected 
rates  of  change  in  each  trend  considered.  4.  Apply  aaaumed  change-rates  to 
data  base,  projecting  it  over  the  future  time-horizon  selected. 

WHAT  DO  YOU  NEED? 


Deta  requirements  and  availability:  Because  the  method  cen  be  used  for  nearly 
any  topic,  data  requirements  and  availability  vary  greatly,  At  some  level  of 
detail  and  precision,  some  sort  of  data  or  other  information  which  can  be  used 
for  surprise-free  projection  is  almost  always  available. 

People,  Including  Organizational  Back-up:  Analysts  must  be  experienced  with 
respect  to  projection  topic,  know  and  have  access  to  appropriate  data  sources, 
understand  and  be  able  to  uae  basic  tools  of  numerical  projection:.  If  "soft" 
Information  is  used,  explicit  uae  of  subjective  judgment  is  important. 

Time:  Varies  greatly,  depending  on  scope,  nature  of  topic,  amount  of  informa- 
tion included  In  base.  Can  be  one  man-day  to  one  or  more  man-months. 

Money:  Variety  greatly— see  above. 
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FORECASTING  EVALUATION  FORM  #1 


HBgjyi? 

Nana;  SOCIAL  INDICATORS 

Def lnltlon/daacrlptlon;  Social  indicator*  are  atatistical-trand-line  de- 
acriptiona  of  change  in  aoclal  phenomena.  They  cover  a wide  range  of  pheno- 
mena, from  population  change*,  ahifta  in  levels  of  educational  attainment, 
crime  rates,  ahifta  in  political  continents,  to  religious  activity,  and  many  more 
History/degree  of  provanness/pronisei  Modelled  on  the  succeaaful  earlier 
development  of  economic  indicators.  Most  work  has  been  done  since  1960. 

Still  in  ths  rasearch/damonstratlon/axperimental  stage. 

WHAT  DO  YOU  GET? 

Uses  and  limitations i USESt  Diagnosis  of  social  ills,  priori ty-snt ting  for 
aoclal  service  program  development  and  delivery  planning,  predicting  important 
aspects  of  future  states  of  society.  LIMITATIONS:  Not  well-developed  or  accepted, 
causal  linkages  between  indicators  and  phenomena  not  often  clear  or  well-grounded. 

Form(s)  of  Output:  Time-aeries  data  in  graphic  form,  usually  accompanied  by 

interpretative  narratives. 

level  of  Detail:  Since  social  indicator  time-series  are  usually  based  on 

operational  data  (birth  records,  hospital  reports,  crime  reports,  ate.), 
level  of  datall  varies  as  widely  as  scops  of  source  documents. 

Level  of  Confidence:  Very  low.  Input  measures  often  necessarily  used  as 

output  measures.  Example:  Amount  of  funds  spent  on  education  or  number  of  years 
spent  in  school  are  taken  to  represent  levels  of  educational  quality  or 
attainment. 

Span  of  Forecast:  Most  social  indicators  work  to  date  has  emphasised  devel- 

opment of  indexes  based  on  historical  and  current  data.  Development  of  LEADING 
(futures)  indicatoro  la  still  in  primitive  state. 

HOW  DO  YOU  DO  IT? 

Procedures : 1.  Identify  social  phenomenon  of  interest.  2.  Search  for  or  try  to 
develop  statistical  time-series  data  which  can  be  taken  to  reflect  changes  in 
the  phenomena  of  interest.  3.  Asscmble/compile  data.  4.  Refine/extend/attempt 
to  validate  the  data. 


WHAT  DO  YOU  NEED? 

Data  requirements  and  ovoilablllty : REQUIREMENTS:  Time-series  data  on  a uniform 
basis  which  can  be  accepted  as  reflecting  changes  in  the  social  phenomenon  of 
interest.  AVAILABILITY : A great  deal  of  apparently  relevant  data  is  available 


from  many  sources.  CREDIBLE  or  VALID  date  la  difficult  to  find  or  to  develop. 


People.  Including  Organisational  Back-up:  PereonB  experienced  in  theories  of 

social  change  and/or  persona  competent  in  statistical  methodologies. 

Time:  To  date,  social  indicators  is  in  the  research  stage.  Individual  projects 

may  take  as  little  as  30-60  daya.  Principal  projects  have  been  ongoing  for 
several  years. 

Money : As  little  as  one  man-morth  to  many  man-years,  with  corresponding  cost 

variations. 
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FORECASTING  EVALUATION  FORM  H 


WHAT  IS  IT? 

Nan«r  LEADING  INDICATOR  (ECONOMIC) 

Daflnitlon/descriptloni  Any  measure  of  the  economy  thee  moves  in  the  same 
manner  as  the  economy  but  does  eo  several  months  ahead  of  the  economy, 

Hletorv/daarae  of  orovenness /promise i Intensively  developed  by  economists  in 
the  pcrioafollovlng  World  War  II,  as  an  aspect  of  business  cycle  theory. 
Leading,  concurrent,  and  lagging  indicators  are  widely  used  by  economists, 
businessmen,  financiers,  and  government  to  assess  economic  performance, 

WHAT  DO  YOU  GET 7 

Uses  snd  limitations i Useful  in  forecasting  or  planning  budget  levels,  sales, 
profits,  inflation,  ta^  rates,  and  many  other  aspects  of  the  economy.  Primary 
limit!  are  twot  l)Besed  on  peat  trends  and  therefore  may  fail  to  predict  beeic 
changes,  such  as  current  "stagflation",  2)R*quir*a  time  series  data  on  a 
standard  base  over  a period  of  many  years,  which  is  not  always  available. 

Form(e)  of  Output!  Linear  graphs,  numerical  teblea/matricoe. 

Level  of  Detail i Indicators  in  most  general  uae  are  at  the  national  economy 
level.  Some  regional  indicatora  are  also  available,  as  are  industry-level 
indicators  at  the  national  and  regional  levels. 

Laval  of  Confidence i Widely  accepted  end  used  ae  perhaps  one  of  the  moat 
rallabla  clue*  to  ths  future  performance  of  the  economy. 

Span  of  Forecast:  Heavily  emphasise*  the  next  quarter  end  the  next  year. 

Soma  work  haa  bean  done  on  longer  time-span*. 

HOW  DO  YOU  DO  IT? 

Procedures i Many  Indicators  are  generally  accessible  from  the  National  Burerfu 
of  Economic  Research,  Bureau  of  the  Census,  Bureau  of  Labor  Statistics,  Federal 
Reserve  Board,  etc.  To  construct  a leading  indicator,  one  must  find  a trend  in 
which  changes  precede  changes  in  e trend  of  interest,  collect  time-series 
date,  standardise  the  date,  and  graph  the  trends. 

WHAT  DO  YOU  NEED? 

Date  requirement*  end  availability  I Ae  noted  above,  awny  well-established 
leading  indicators  are  published  regularly  by  government  agencies  and  other 
aourcaa. 

People.  Including  Organisational  Back-up!  Analysis  of  existing  leading  indi- 
catora requires  appropriately  experienced  economists  end  others  familiar  with 
the  details  and  problem*  of  whichever  economic  variables  are  being  tracked. 

Time i 1.  Interpretation  of  indicators  maintained  and  published  by  others  can 
require  modest  amounts  of  time  (few  hours  par  munth)  or  much  greater  time  for 
special  studies.  2.  Index  construction  may  require  several  man-years  of  effort. 

Money t Nominal  to  modest  cost  to  access  end  interpret  existing  indicators. 

Index  construction  and  validation  may  cost  tens  of  thousands  of  dollars,  or 
mora. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 

Name;  CHANOE  SIGNALS  MONITORING 

Def ini tlon/descr lotion i A systematic,  four-atap  proeadura  propoaad  by  Jaaaa 
Bright.  It  involvaai  l)Monitor  environment  for  pracuraor  algnala  (aae 
PRECURSOR  EVENTS,  aaparata  antry)(  2)Idantlfy  altarnatlvc  conaaquanoaa  If 
algnalad  ehangaa  ara  valid  and  paralat)  3)Salact  It asm  to  aonltor  continuously 
4)0rganisa  praaant  raaulta  of  aonltor lng  to  aanagaaant. 

Hlatory/dagraa  of  provinnaia/proalaai  Bright  first  propoaad  ths  txpliclt 
proeadura  In  a 1970  article  in  HARVARD  BUSINESS  REVIEW.  Ha  polnte  out, 
however,  that  a laaa  formal  version  of  his  procedure  has  long  baen  common 
practice  in  buainasa. 

[ WHA^DCnro^gT? 

[ Uses  and  limitations!  USES:  Baala  for  organising  inforaatlon  and  intelligence 

<■  system,  focussing  attention  on  key  avants/tranda.  LIMITATIONS i Requires  model 

| or  theory  which  ralatas  pracuraor  signals  to  changes  of  interest)  algnala 

t aay  be  obscure  or  difficult  to  interpret. 

t Porrofa)  of  Output i May  be  numerical  tablaa,  graphic  data,  narratives. 


Level  of  Detail i Variable  depending  on  nature  and  number  of  signals 
monitored , effort  expended  to  interpret  signals. 

Laval  of  Confidante l Limited.  Main  utility  la  as  a preliminary  acraanlng 
Indicator,  attention  focuasar. 

Span  of  Forecast i Varies,  dependent  upon  assumed  or  estimated  tlaa-lag 
between  the  precursor  signal  and  the  change  foraaean. 

HOW  DO  YOU  DO  IT? 


Procedures;  1.  Identify  change(a)  of  interest.  2.  Identify  precursory  algnala 
presumed  to  foreshadow  the  change.  3.  Organise  /maintain  system  for  identifying 
and  monitoring  change  algnala.  4.  Organise  method  for  regularly  and  system- 
atically reporting  results  of  monitoring  to  pertinent  decision-makers , 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability!  List  of  important  changes  to  be  followed, 
information  base,  procedures  for  organising/monitoring  inforaatlon  base. 

People,  Including  Organisational  Back-up;  Analysts  knowledgeable  about  changes 
of  interest,  experienced  in  development  andmaintainance  of  monitoring  eyitema. 


Time:  Initicl  readouts  from  system  will  require  at  leaat  a few  weeks  in 
* simplest  systems)  a year  or  more  may  be  required  for  ueeful  outputs  from  more 

ambitious  systems.  Thereafter,  system  may  be  tapped  continuously  at  any  time. 

Money i Nominal  for  simple  Bystems,  hundreds  to  thousands  of  dollars  to 
[ develop  and/or  maintain,  depending  on  size  and  complexity  of  system. 


i 


i 
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FORECASTING  EVALUATION  FORM  01 

WHAT  IS  IT? 

Name:  CRITICAL  FACTORS  ANALYSIS 

Dif inltion/deacrlptloni  A (pacific  consensus- judgment  method  devleed  by 
George  Steiner.  May  aleo  refer  more  broadly  to  a atep  in  ayatems  analyais 
or  in  the  CRITICAL  PATH  METHOD  (for  which  (ee  asperate  entry) . 

History /degree  of  provenneag/promlaai  In  the  mid  60a,  Steiner  identifiod 
71  strategic  factors  thought  to  be  of  critical  importance  in  the  aucceaa 
of  an  enterprise.  He  made  a worldwide  survey  of  business  executives  in  which 
they  selected  60  factors  as  being  of  average  or  greater  importance. 

WHAT  DO  YOU  GET? 

Uses  and  limitations:  USES:  In  any  situation  or  mission  which  can  be  reasonably 
well  delimited  and  for  which  experienced  participants  can  be  identified,  method 
enables  a consensus  judgment  on  which  issues  or  problems  are  and/or  will  be 
in  future  most  important  for  success,  LIMITATIONS:  Depends  on  subjective 
judgments,  selection  of  judges  may  be  difficult,  severe  disagreements  may  be 
difficult  to  reconcile. 

Form(s)  of  Output:  Descriptive  listing  of  pertinent  factors,  together  with 

tabulation  of  ranking  scores  Judging  importance. 

Level  of  Detail:  Because  the  persons  whose  judgment  is  sought  are  experienced 

with  respect  to  the  forecast  topic,  explicit  detail  is  usually  limited. 

Level  of  Confidence:  Because  this  is  e qualitative,  subjective-judgment  method, 

level  of  confidence  depends  on  users'  assessment  of  judges'  competence. 

Span  of  Forecast:  In  Stsiner's  study,  the  time-span  was  "timsless"!  that  is, 

hs  looked  for  factors  which  will  ALWAYS  be  critical  to  success.  For  a specific 
mission,  the  time-apan  la  set  by  the  estimated  time  required  to  complete  mission 

HOW  DO  YOU  DO  IT? 


Procedures : 1.  Identify  the  forecast  topic.  2.  From  literature,  other  sources 
prepare  draft  Hat  of  critical  factors.  3.  From  literature  or  other  aources, 
identlfy/obtain-participation  of  experienced  judges.  4.  Ask  each  judge  to 
rank-order  factors  by  order  of  importance.  5.  Tabulate  returne,  rank-order 
factors  by  Importance  according  to  overall  ratings  assigned  by  judges. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  ovallabllity;  REQUIREMENT:  Knowledge  of  the  topic, 
access  to/cooperation  of  qualified  judges.  AVAILABILITY:  Where  topic  ia  broad 
or  vague,  knowledge  and  identification  of  competent  judges  may  be  difficult. 

People,  Including  Organisational  Back-up:  A project  leader  skilled  in  survey 

research  techniques,  and  a roster  of  qualified  judges  willing  to  participate 
in  the  survey. 

Time:  Only  a few  weeks  (at  best,  even  days)  may  be  required  if  the  judgeB  are 

few  and  physically  accessible  in  one  area.  More  ambitious  surveys  may  require 
several  months  or  a year. 

Money:  Varies  widely  with  scope  of  project— eee  above. 
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WHAT  IS  IT? 


NiMt  ESTIMATES  OF  PREFERENCES 


Daflnltlon/doscriPtioni  Refare  to  any  of  a wide  varlaty  of  procedure*  aa- 
ployed  to  rank-order  a specified  aet  of  optiona/cholces  within  a population 
viewed  a*  critical  to  the  accaptanca/rajactlon  of  one  or  nore  of  the  apaclfled 
optiona/choleaa. 

Hlstory/dearae  of  provannasa/promlaa:  Perhaps  elections  are  among  the  oldaat 
examples,  In  elections • qualified  voters  express  their  prefatencea  among 
candidate  leaders  for  a specified  future  period.  The  moat  rigorous  end 
elaborate  methods  are  those  used  in  market  research  and  in  survey  (opinion) 
research. 

WHAT  DO  YOU  CET7 

Uses  and  limitations i USES:  Permits  users  to  evaluate  the  aase/dlfficulty  of 
"selling"  a given  option  to  a given  population.  LIMITATIONS:  Fields  statistical 
results,  thus  embodies  the  problems  of  sample  sisa/reptesentatlveness,  time- 
money  costs,  missing  rapidly  shifting  preferences,  etc. 


Form(e)  of  Output:  A sat  of  weighted,  intercorralated  statistics  together 

with  an  explanation  and  interpretation  of  the  purported  significance  of  the 
statistics. 

Level  of  Detail:  Depending  on  the  topic  and  the  amount  of  resources  invested, 
this  method  may  yield  any  level  of  detail  desired,  although  it  may  often  be 
difficult  to  decide  when  the  detail-level  is  spacious  rather  than  actual. 

Level  of  Confidence:  Where  the  topic  and  procedures  have  been  widely  uead— 
aa  in  market  research  and  opinion  research— much  confidence  can  be  placed  in 
these  methods.  In  other  applications,  level  of  confidence  uarned  vurles  widely. 

Span  of  Forecast:  In  theory  any  time-span  might  be  employed.  In  practice, 
it  is  assumed  that  preference  shift  markedly  over  a period  of  at  least  a few 
weeks  and  at  most  a very  few  years. 

HOW  DO  YOU  DO  IT? 


Procedures:  1,  Specify  the  topic.  2.  Specify  the  options  to  be  assessed. 

3.  Devise  specific  survey  lnstruments/proceduree.  4.  Train  or  retain  personnel 
experienced  in  thane  methodologies.  3.  Pre-test  instrument.  6.  Conduct  one  or 
more  rounds  of  survey  from  a apaclfled  sample  of  a specified  population. 

6.  Aseaaa  resulte. 

Date  rsQulrwnenta  and  availability!  Most  data  required  concerns  the  definition 
and  charecterletica  of  the  population  to  be  sampled.  In  applications  where 
this  method  has  been  widely  used  for  a long  time,  extensive,  reliable  data  ia 
accessible,  In  other  caeee,  raquiraasnte/availability  vary  greatly. 

People.  Including  Organisational  Back-up:  Requires  a group  experienced  in 

thee*  methods,  plus  substantial  resources  to  survey  the  sample,  process  data, 
Interpret  reiulta, 

Time:  Moat  applications  require  at  leaat  a few  weeks  for  results,  while 
many  require  a year  or  even  longer. 

Money:  Not  inexpensive,  At  least  a few  hundred  dollars  and  up  to  many 

thousands  of  dollars  would  be  the  typical  range. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 


Name:  SUBJECTIVE  ESTIMATES  OF  PROBABILITY 

Definition/description:  Refers  to  a wide,  diverse  range  of  procedures— implicit/ 
explicit,  informal/formal,  organised/unorganised— primarily  dependent  on 
intuitive  estimates  not  well-documented— or  even  documentable — by  valid, 
reliable  data.  Delphi  methods,  opinion  polls,  "eeat-of-the-pants"  estimates, 
are  a few  examples. 

Hlatory/dearee  of  provennesa /promise:  As  old  as  humanity.  Every  personal  or 
collective  action  or  behavior  is  based  on  soma  set  of  intents,  goals,  and 
objectives  which  can  be  realised  only  in  future— the  next  minute,  tomorrow, 
next  year,  etc.  Many  actions— perhapa  most— are  taken  when  the  attainability 
and  Impact  of  intended  outcomes  is  unknown,  or  even  unknowable. 

WHAT  DO  YOU  GET? 

Uses  and  limitations i USES:  Widely  used  when  the  impact  of  uncertainty  is 
considered  insignificant  or  unmanageable.  LIMITATIONS:  Much  recent  work  in 
psychology  suggests  that  there  are  severe,  characteristic  constraints  on 
subjective  probability  estimates,  especially  in  complex,  rapidly  changing 
environment, 

Form(s)  of  Output:  Often  implicit  in  decisions  or  action  t ken.  Often  only 
alluded  to  or  unconsciously  expressed  by  the  eatimator.  At  the  moat  elaborate 
end  of  the  spectrum,  multi-round  pools  with  feedback  and  otatlstlcsl  analysis 
may  be  employed,  as  in  the  Delphi  method. 

Level  of  Detail:  As  variable  as  the  endlees  number  of  eituetions  in  which 
intuitive  Judgment  ie  relied  upon, 

Level  of  Confidence:  Becauee  the  method  is  subjective,  so  is  the  level  of 

confidence  assigned  by  the  user  of  the  method,  or  by  the  recipient  of  the 
user's  results.  If  you  respect  the  person's  Judgment  and  coneiiler  his  ex- 
perience appropriate,  you  tend  to  have  confidence  in  his  estimates. 

Span  of  Forecast:  May  often  be  unstated,  or  can  be  any  time  interval  the 

estimator  feels  competent  to  foresee. 

HOW  DO  YOU  DO  IT 7 

Procedures!  1.  Identify  the  topic,  2.  Select  the  person(s)  whose  estimate  ie 
to  be  accepted.  3.  If  applicable,  specify  procedures  to  be  followed  in  making 
the  estimate.  A.  Apply  procedures.  5.  Assess  the  resulting  estimates. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability:  Varies  greatly.  No  explicit  data  may  be 
required  in  the  most  informal  case,  while  vest  reams  of  date  with  analysis 
of  estimation  procedures  end  results  may  be  invoked  in  the  most  elaborate  case. 

People.  Unci udlng  Organizational  Back-up:  Varies  from  one  person  whose  estimates 
are  to  be  accepted  to  in-uouse  or  retulned  survey  research  organisations. 

Time!  Ten  minutes  to  one-man-year  or  oven  longer.  (Yonkelovich,  Callup,  and 
others  offer  services  on  a continuous  basis) 

Money  ; VarieB  widely— see  above. 


31 


FORF.CASTINC  EVALUATION  FORM  fil 


WHAT  IS  IT? 

Name  I PREDICTION  OF  CHANCE-OVER  POINTS  (see  alto  ENVELOPE  CURVES) 

Deflnltlon/daacription:  Innovations  (aapacially  technological)  are  often  found 
to  emulate  In  auch  a way  that  improvement*  immediately  after  invention  are  rapid, 
then  alower  until  meat  of  that  invention's  contribution  to  improvement  haa  been 
realised.  Aa  a curve,  this  la  the  familiar  S-ahapad  or  growth  curve.  Often, 
when  one  curve  haa  bean  "saturated"  a new  innovation  with  a new  curve  appears. 

A so-called  ENVELOPE  curve  can  be  drawn  which  encloses  successive  growth  curves. 

A CHANGE-OVER  point  la  that  point  along  an  envelope  curve  at  which  one  growth 
curve  is  succeeded  by  another. 

Hlatory/detree  of  provenneaa/promlae:  BIOLOGICAL  growth  curves  have  bean  well- 
established  for  eeveral  decades.  Within  the  past  20-30  years,  it  haa  been  generally 
accepted  (by  general  systems  theorists  and  others)  that  many  non-blologlcal 
phenomena  replicate  growth-curve  evolution.  Many  attempts  have  been  made  to 
give  epecific  applications  of  this  analogy,  but  are  not  entirely  convincing. 
WJWTDOYOyjET? 

Hues  and  limitations!  USESi  Taken  with  other  indicatore,  can  yield  better-than- 
random  timing  estimates  aa  to  whan  new  innovations  may  be  expected  in  a given 
field.  LIMITATIONS:  There  la  no  adequate  theory  to  explain  the  etructure, 
dynamics,  and  scheduling  of,  say,  technological  advances  which  satisfactorily 
equates  It  with  comparable  models  explaining  biological  growth. 

Form(a)  of  Output:  Given  a aeries  of  growth  curves  within  an  envelope  curve, 
change-over  points  are  indicated  and  located  either  by  some  specified  functional- 
sttainment  date  or  by  estimated  calendar  date. 

Level  of  Detail:  Orowth  curves  typically  describe  a single  parameter  in 
graphic-numeric  profiles. 

Level  of  Confidence:  Limited,  since  there  ia  no  basic  theory,  and  especially 
no  theory  which  suggests  how  to  identify  where  along  a given  growth  curve 
a given  phenomena  ia  now  located. 

Span  of  Forecast:  Tends  to  range  from  two-threo  years  to  15-20  yeara. 

HOW  DO  YOU  DO  IT? 

Procedures:  1.  Identify  the  performance  or  other  phenomenon  ol  interest. 

2.  Identify  the  functional  parameter(s)  which  describe  improvements  in  that 
performance.  3.  For  each  parameter,  plot  its  past  record,  usually  in  terms  of 
date  a given  new  peak  value  is  attained.  4.  Project  parameter  to  saturation. 

5. On  bants  of  projection,  Infer  when  a new  growth  curve  should  be  expected  to 
"take  over"  improvement. 

WHAT  no  YOtl  NEED? 

Data  requirements  and  availability:  Requires  datu  of  past  peak-value  attainment 
for  parameters  of  Interest.  These  are  often  available  in  unambiguous  farm  for 
technological  advances,  much  leas  often  for  other  forms  of  change,  especially 
social  change. 

People,  Including  Organisational  Back-up:  An  analyst  who  is  experienced  with 
the  technology  in  question,  including  future  candidate  technologies,  and  who 
understands  numerical  projection  methods. 

Time:  If  datu  la  at  hand  and  performance  parameters  oE  interest  arc  known,  a 
few  days  may  provide  preliminary  predictions,  If  nsoumptlons  and  data  must  be 
developed,  refined,  and  aRraed  upon,  several  man-months  over  two  years  nr  more 
may  he  required. 

Money : Varies  greatly — see  above. 


WHAT  IS  I?? 


FORECASTING  EVALUATION  FORM  //I 


Nang:  AMPLITUDE-ADJUSTED  INDEX 

Definltion/daecrlption:  A composite  index  of  several  economic  indicators  whose 
interval-to-interval  variations  vary  a great  deal.  EXAMPLE:  New  order  indicators 
may  vary  a great  deal  from  week  to  week,  while  the  average  workweek  varies  only 
slightly  from  year  to  year.  The  Individual  indicators  are  adjusted  so  that  each 
varies  about  its  own  average,  making  the  individual  indicators  more  comparable. 
History /degree  of  provenness/promlse:  The  use  of  composite  indexes  has  devel- 
oped  in  the  general  environment  of  economic  research  and  practice  aince  th* 

1950s.  Like  all  economic  indexes,  composite  indexaB  are  seen  as  intermediary 
between  purely  intuitive  judgments  and  rigorous  theory,  thus  requiring  careful 
interpretation. 

WHAT  DO  YOU  GET? 

Uses  and  limitations:  USES:  For  forecasting  purposes,  one  ran  fashion  composite 
indexes  out  of  a sot  of  LEADING  economic  Indicators  (see  entry  on  ECONOMIC 
INDICATORS).  LIMITATIONS:  Where  leading  indicators  of  interest  arc  few, 
unreliable,  or  unusually  diverse,  interpretation  of  the  composite  index  may 
be  difficult  or  unreliable. 

Form(s)  of  Output:  Tabular  or  graphic  plots  showing  the  variations  of  the 
individual  Indexes  about  their  respective  means,  and/or  the  variation  of  the 
composite  index  number  about  its  mean. 

Level  of  Detail:  Economic  indexes  by  design  are  general,  abstract,  lacking 
in  specific  detail,  and  may  omit,  mask,  or  under-represent  significant  particulars, 
Level  of  Confidence:  Depends  essentially  on  the  competence  of  the  economists 
constructing  the  .Index  and  on  the  confidence  placed  in  them  by  users.  The 
National  Bureau  of  Economic  Research  is  the  most  respected  source  in  the  fluid. 

Span  of  Forecast  1 Economic  indicators  generally  are  dependent  on  business 
cycle  analysis,  which  typically  deals  in  periods  of  a few  monthB  to  a few 
years— say  quarterly  to  biannual  intervals. 

HOW  DO  YOU  DO  IT? 

Procedures;  1.  Identify  economic  phenomenon  of  interest.  2.  Identify/eelect 
leading  indicators  which  pertain.  3.  Compute  the  mean  and  mean  variation  for 
each  indicator  for  some  past  period.  4.  Combine  the  mean  variations  for  all 
indicators  into  a composite  variation  value,  and  plot  it.  5.  Drawing  on 
business  cycle  theory,  estimate,  the  future  timing  and  degree  of  impact  on 
the  phenomenon  of  interest. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability:  REQUIREMENTS:  A set  of  pertinent  leading 
indicators  or  the  meanB  to  construct  same.  AVAILABILITY:  Those  in  general  use 
are  readily  available  from  federal  and  other  sources. 

People,  Including  Organizational  Back-up;  Economists  trained  and  experienced 
in  the  construction  and/or  interpretation  of  composite  indexes  are  required. 

Time:  Interpretation  of  published  composite  leading-indicator  indexes  may 
require  only  a few  hours  or  days.  Construction  of  special-purpose  indexes 
may  require  a few  weeks  or  months  and  several  man-weeks  to  man-months  of  effort. 
Money : Depends  on  effort  level  required— see  above. 
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FORECASTING  EVALUATION  FORM  1)1 


WHAT  IS  IT? 

Name ! DIFR'SION  INDEX 

Def lnttlon/deacrlptlon:  A measure  of  the  extent  to  which  a set  of  indicators 
related  to  given  economic  phenomena  are  varying  together  and  in  the  same 
direction.  EXAMPLE:  Inflation  trends  can  be  assessed  by  price  indexes,  pro- 
ductivity Indexes,  and  aupply/demand  indexes.  A Diffusion  Index  would  show 
whether  all  are  rising,  all  falling,  or  some  combination. 

History/degree  of  provanness/proalse:  Developed  largely  by  Geoffrey  H.  Moore 
and  the  National  Bureau  of  Economic  Research  during  the  1960s.  N&ER  is  the 
single  most  distinguished  and  influential  economic  research  organisation  in 
the  L'.S.  A systematic  but  subjective  judgmental  estimate  about  the  rate  and 
direction  of  change  in  some  economic  phenomenon. 

WHAT  DO  YOU  GET? 

lisas  and  limitations:  USES:  Good  for  a preliminary  quick  look  at  some  economic 
phenomenon  to  see  if  there  is  any  evidence  that  a conjectured  change  may  be 
occurring.  LIMITATIONS:  Ultimately  depends  upon  experienced  but  subjective 
best  judgment. 

Form(a)  of  Output:  An  array  of  the  current  readings  of  the  indicators  which 
sre  judged  pertinent  to  the  phenomenon,  pluu  an  oral  or  wrlttan  narrative 
given  the  expert's  estimated  interpretation  of  the  direction  and  rate  of  change 
indicated  in  the  cseoclated  economic  phenomenon. 

Laval  of  Detail:  Very  general,  sbatrBCt,  but  varies  with  the  number  of  indicators 
which  can  plaualbly  be  associated  with  the  economic  phenomenon  studied. 

Level  of  Confidence:  Because  it  is  a aubjactive  judgment  approach,  tha  level 
of  confidence  is  determined  by  the  degree  of  confidence  imputed  to  the  expert 
consulted,  on  the  basis  of  his  professional  experience  and  performance. 

Span  of  Forncaat:  The  diffusion  index  is  based  upon  business  cycle  indicators, 
which  typically  look  only  a few  months  or  st  best  2-3  years  ahead. 

HOW  DO  YOU  DO  IT? 

Procedures:  1.  Specify  the  economic  phenomenon  of  interest.  2.  Decide  on  and 
assemble  economic  indicators  held  to  be  associated  with  it.  3.  For  each  indi- 
cator, assess  the  direction  and  rate  of  recent  changes  in  that  indicator. 

4.  Estimate  the  overall  rate  and  direction  of  change  Implied  by  tlte  indicator 
set.  5.  Report  and  interpret  the  estimate  made  in  4. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability  I Requires  access  to  pertinent  economic  indi- 
cators, usually  a routine  matter  aa  such  data  is  widely  published.  Getting 
current  indicator  data  can  be  a problem  if  the  phenomenon  of  interest  la 
thought  to  be  changing  rapidly,  since  indicators  tend  to  be  published  at 
quarterly /annual  intervals. 

People,  Including  Organisational  Back-up:  An  economist  trained  and  experienced 
in  the  construction  and  interpretation  of  diffusion  Indexes. 

Time:  Tn  simple  cases,  a few  days.  Where  more  then  one  opinion  is  needed  or 
many  indicators  must  be  assembled  and  examined  a few  weeks  or  even  a few  months 
might  be  required.  The  easier,  shorter  time  frame  is  perhaps  more  typical. 

Money : Depends  on  the  compensation  rate  of  the  one  or  a few  professional 
economists  employed — a few  hundred  to  e few  thousand  dollars. 


FORECASTING  EVALUATION  FORM  #1 
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WHAT  IS  IT? 

Name;  AUTHORITY  or  "GENIUS"  FORECASTING 

Def initlon/descriptioni  These  are  forecasts  made  by  individuals  thought  to 
be  authorities  in  the  field.  Such  forecasts  range  from  off-hand  judgmental 
conclusions  to  carefully  documented  and  weighed  analyses. 

History/degree  of  provenness/promi  e«i  An  old  and  common  (perhaps  the  commonest) 
forecasting  technique.  Certainly  the  value  of  informed  judgment  is  well 
established.  It  is  sIbo  well  established  that  even  tha  beat  informed  can 
be  very  wrong. 

WHAT  DO  YOU  GET? 


Uses  and  limitations  I An  especially  good  way  to  obtain  a quick  idea  of  expert 
opinion  in  an  area.  Limitations  include  prospecte  of  over-reliance  on  "the" 
expert;  bandwagon  effects;  and  the  ever-present  possibility  of  the  authority 
being  out  of  date,  close-minded,  or  interested  less  in  his  forecast  than  in 
his  fee  and  reputation. 

Form(a)  of  Output!  No  set  form. 

level  of  Detelli  Range  from  great  detail  to  global  generality. 

Level  of  Confidence;  Often  very  high,  especially  if  the  genius  forecast  is 
confirmed  by  independent  cross-checks.  A real  problem  is  that  the  level  of 
confidence  ia  sometimes  unrealistically  high. 

Span  of  Forecaati  Can  cover  any  apan. 

HOW  PO  YOU  DO  IT? 


Procedures!  Usual  pattern  ia  to  pose  the  question  to  the  authority  and  let 
him  respond  In  any  way  he  wishes  to. 

WHAT  DO  YOU  NEED? 


Data  requirements  and  availability!  These  are  the  responsibility  of  the  genius. 
People.  Including  Organizational  Back-up!  All  that  is  needed  1b  the  genius. 
Time;  Great  range. 

Money i Great  range. 
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FORECASTING  EVALUATION  FORM  /'I 


Nine;  SURVEYS  OF  INTENTIONS  OR  ATTITUDES 

Dcflnltion/datcrlptloni  Survey!  of  thii  type  conaise  of  taking  people  their 
plane  for  the  future  or  thalr  feellnga  about  Item*.  The  standard  public  opinion 
poll  la  the  beat  known  example  of  thla  technique.  Scope  can  be  broad  or  Halted. 
Such  eurveye  are  to  be  dlHtingulahed  from  aurvaya  to  get  data  on  activities 
or  units. 

Hlstorv/detree,  of  provannaas/proalsei  Well-known  surveys  of  this  sort  include 
McCraw-Hlll,  Commerce-SEC,  and  Fortune  aurvaya  of  business  plant;  several 
aurvaya  of  conaumer  buying  plans;  studies  of  values  and  attitudes  of  people 
made  by  Yankalovlch,  Potomac  Association  and  Survey  Research  Center. 

WMTJOj2gCg£7 

Uses  and  limitations  I Product  Is  statements  of  expectations  or  viewpoints. 

This  la  the  chief  way  to  gat  aysteaatlc  data  on  plans  and  priorltiea  of 
institutions  and  individuals.  Technique  does  not  work  for  unplanned  (impulat) 
deciaions. 

Form(a)  of  Output!  Anawera  to  specific  quest Iona. 

Level  of  Datalli  Entirely  flexible— from  global  to  finest  grain. 

Level  of  Confldencei  Confidence  level  ia  seldom  high  for  consumer  purchasing 
intentions  and  declines  with  spaclficlty  of  product  and  remoteness  of  planned 
action.  Probability  techniques  improve  reliability.  Attitude  deta  ere  subject 
to  semantic  uncertainties.  Both  types  of  results  are  ouch  influenced  by 
unexpected  events. 

Span  of  Forscasti  Moat  survey  of  plans  focus  on  quarterly  and  annual  end-points. 

Procedures:  (1)  Identify  the  data  to  be  collected,  (2)  develop  questionnaire, 

(3)  select  repreeentatlve  sample,  (A)  conduct  survey  and  record  results, 

(3)  interpret  findings.  Mall,  telephone,  and  in-person  surveys  are  common. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability i Often  difficult  to  elicit  clean  responses 
to  planned  actions  or  complex  attitudinal  issues. 

FlPBk..  Including  gqunlail2nil  Expertise  Is  required  on  study 

design,  questionnaire  development,  telephone  or  in-person  Interviswing,  sta- 
tistical analysis  of  results.  Computer  facilities  often  required  for  analysis 
of  findings. 

Time;  Minimum  of  a month  or  two;  major  surveys  require  six  or  more  months. 

Money : Small  mall  surveys  might  be  done  for  s few  thousand  dollars;  complex 

in-person  studies  cost  hundreds  of  thousands  of  dollars,  much  of  it  in 
generating  and  pretesting  questionnaires. 
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Name!  SURVEYS  OF  ACTIVITIES  OR  UNITS 

Deflnition/descriptlons  Survey*  of  ectivltlea  or  unite  conalat  of  asking 
people  epecific  questions  concerning  past  events.  Survey  can  be  national  or 
leas  in  scope  and  can  eovar  broad  >'  specific  areas.  Theta  surveys  era  to  be 
distinguished  from  surveys  of  intentions  or  attitudea. 

History /degree  of  provenneee/promleei  Among  the  beet  known  surveys  of  this 
type  are  the  various  census  studies,  Commsrcs-SEC  surveys  of  currant  business, 
and  a numerous  data  collecting  efforts  on  behalf  of  special  interacts.  Data 
surveys  underlie  the  large  majority  of  forecasts. 

KHAT  DO  YOU  GET? 

Uses  and  limitations!  The  product  is  historical  data  essential  as  the  basis 
for  projections.  Surveys  can  be  made  on  almost  any  subject.  Limitations  depend 
on  the  nature  and  source  of  the  series. 

From(a)  of  Output i Repliaa  to  specific  questions.  Repeat  surveys  are  often 
presented  in  time-series  tables  or  charts. 

Level  of  Detail t Level  of  detail  can  bo  very  fine-grained  or  global. 

LeveL  of  Confidence!  Far  established  surveys,  such  as  the  Census  and  soma 
major  sales  surveys,  the  level  of  confidence  is  very  high.  Surveys  employing 
an  adequate  sample  are  not  reliable. 

Span  of  Foracaati  These  kinds  of  aurveys  provide  the  basis  for  forecasts  but 
are  not  in  themselves  forecasts. 

HOW  DO  YOU  DO  IT? 

Proceduresi  (1)  Identify  data  to  be  collected,  (2)  develop  questionnaire, 

(3)  select  representative  sample,  (4)  conduct  survey  and  record  responses, 

(5)  interpret  findings.  Mall,  telephone,  and  in-person  aurveys  are  common. 

WHAT  DO  YOU  NEED? 


Data  requirements  and  availability i In  some  circumstances  steps  (1),(3)  and 
(5)  present  difficulties,  W in  most  cases  survey  work  1b  straightforward. 

People.  Including  Organisational  Back-up:  Survey  and  questionnaire  design 

are  specialty  fields;  extensive  field  work  requites  trained  personnel;  data 
often  must  be  analysed  via  computer  facilities  backed  by  statistical  know-how. 

Time!  Appreciable  surveys  require  a matter  of  months  in  preparation,  conduct, 
and  analysis. 

Money t A typical  10-item  mail  survey  of  1000  respondents  would  usually  cost 
between  $2000  and  $5000;  in-depth  survey  of  the  same  items  utilizing  trained 
interviewers  would  cost  $10,000  to  $25,000  and  up. 
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FORECASTING  EVALUATION  FORM  (Cl 


WHAT  IS  IT? 


Kami  PANELS 

Daflnltlon/dsacriptloni  In  chla  technique  axperta  art  brought  together  in 
opan  diaeuaalon  to  raach  a consanaua  Judgment  concerning  the  future  of  a 
apacifled  trend  or  proepect.  Delphi  la  a apecial  caae  of  the  uae  of  panele 
for  forecaating. 

Hlatorv/dearee  of  arovanneae/promleei  One  of  the  oldeat  of  all  forecaeting 
technique!.  Claaalc  examples  of  this  technique  include  Project  Forecaat  of 
the  Air  Force  and  Project  Seabed  of  the  Navy. 

WHAT  DO  YOU  GET? 

- 

Usee  and  limitations!  Panel  forecaating  ia  suitable  (but  not  necessarily  heat} 
whenever  expert  opinion  is  the  major  input.  The  method  is  fast,  straightforward, 
and  easy  to  conduct.  Limitations  Include  the  danger  of  generating  a "band- 
wagon" majority  opinion.  In  addition,  apacialiats  are  often  unwilling  to 
abandon  in  public  previously  expressed  opinions. 

?orm(e)  of  Output!  Usually  in  narrative  form,  backed  by  whatever  data  the 
panel  used  in  aupport  of  conclusions. 

Level  of  Datsili  Technique  can  be  uaad  for  all  levels  of  detail,  but  appears 
to  be  used  chiefly  with  problems  of  intermediate  or  grosser  detail. 

Level  of  Confidencei  Vary  difficult  to  assess.  Depends  on  insight  of  panel, 
nature  of  topic  being  forecast,  and  complexity  of  forces  affecting  the  forecast. 

Span  of  Forecaat i No  limitations. 

HOW  DO  YOU  DO  IT? 

Procedures!  Simple  open  discussion  by  panel  members,  with  or  without  etructure. 
WHAT  DO  YOU  NEED? 


Data  requirements  and  availability  I Usually  panel's  knowledge  provide*)  the 
necessary  data. 

People.  Including  Organizational  Back-up;  Panel  plua  recorder  and  aummariaer. 

Time!  Can  range  from  an  hour  to  several  days  or  more. 

Money i Coats  are  minimal  for  informal  panels  but  can  be  considerable  for 
extended  conferences  of  high-fee  panelists. 
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FORECASTING  EVALUATION  FORM  #1 

Vg^ISJJ? 

Nanai  DELPHI 

Daflnltion/daacr lotion:  Thla  technique  anploya  a panel  of  axparta  to  render 
judgment*  aa  to  timing,  probability,  and  often  lmplicationa  of  apeclfled  trends 
and  avanta.  The  technique  differs  from  the  usual  panel  discussion  in  main- 
taining anonymity  of  panel  mambara,  iteration  of  results  with  controlled 
feedback,  and  statistical  group  response. 

Hlstory/dearaa  of  orovenneas/oromlaai  The  technique  was  developed  in  the 
early  1960s  at  RAND.  Some  4000  Delphis  are  said  to  have  been  done.  A 
popular  forecasting  technique,  there  are  many  variations  of  the  classic  method. 

WHAT  DO  YOU  GET? 

Usee  and  limitations:  Delphi  is  used  where  qualitative  judgment  la  the  main 
input.  The  method  Is  adaptable  to  almost  any  aubject  matter.  It  is  helpful 
in  bringing  together  a wide  spectrum  of  expertise  and  in  exposing  related 
factors  or  linkages.  Limitations  are  in  reliability  of  judgment  and  in  the 
usual  practice  of  reporting  only  majority  viawpoints. 

Form(a)  of  Output!  Concise  statements  of  timing,  probability,  and  likely 
impacts  of  specified  trends  of  developments.  Often  presented  in  tables  or 
curvaa . 

Level  of  Detail i Method  can  deal  with  any  level  of  detail,  but  moat  Delphis 
treat  issues  cf  medium  or  larger  scale. 

Level  of  Confidence:  Not  established  and  perhaps  unestablishable.  In  general, 
howevsr,  forecasts  are  considered  markedly  better  than  those  available  from 
panels  of  non-experts,  and  probably  better  than  those  by  single-person  forecasts, 

Span  of  Forecasts:  Typical  range  is  10-50  years,  but  can  be  for  any  period. 

HOW  DO  YOU  DO  IT? 


Procedures:  A panel  of  experts  is  asked  to  give  their  judgment  on  the  future 

of  specified  trende  or  event! . Responses  are  summarised  and  returned  to  panel 
for  re-assessment  of  previous  judgments.  Usuallly  three  iterations  are 
Involved.  Anonymity  of  panel  reduces  bandwagon  effects. 

WHAT  DO  YOU  NEED? 

Data  raqulremsnta  and  availability:  (1)  Knowledge  of  who  is  "expert"; 

(2)  explicit  definitions  of  topic'll  to  be  forecast;  (3)  directions  on  what 
la  to  be  rated  and  how  described. 

People.  Including  Organisational  Back-up:  Some  familiarity  with  method  is 

required  of  Delphi  leader.  Considerable  editorial  and  clerical  back-up  is 
required. 

Time:  Minimum  time  for  usual  mail  Delphi  la  about  six  weeks;  most  take  about 
six  months. 

Money : Coats  are  moderate--? 5000  and  up.  Main  coats  are  in  honoraria  for 
experts,  mailing,  data  reduction,  and  reporting. 
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FORECASTING  EVALUATION  FORM 


WHAT  IS  IT? 

Nana:  PSYCHOCRAPHICS  or  LIFE  STYLE 

Def lnltion/descrlptloni  This  la  a i.e-lmlque  lor  correlating  people'e  external 
needs,  opinions,  Income,  demographic*,  etc.,  with  their  actiona  and/or  thair 
atated  opinlona.  A10  (reported  elsewhere)  is  a variant  of  psychographica. 

Reaearch  on  Ufa  ways  (also  reported  elaewhere)  ia  allied  but  distinct  in  that 
it  deals  explicitly  with  deep  motivating  values  rather  than  with  patterns  of 
behavior. 

History/degree  of  provenneaa/promlsai  Intuitive  use  of  life  styles  for  fore- 
casting market  and  societal  trends  goes  back  a long  ways.  Its  formal,  academic 
use  is  hardly  a decade  old  and  ia  confined  largely  to  market  studies.  The 
approach  ia  far  from  provan.  Its  promise  la  probably  greatest  for  broad-gauge 
market  forecasting. 

WHAT  DO  YOU  GET? 

Uses  and  limitations!  Psychographic  profiles  correlate  with  many  of  an  indi- 
vidual'a  views  end  actiona.  Can  be  used  aa  a forecasting  device  by  aaking 
what  people  will  do  (want,  etc.)  under  various  circumstances,  Limitations 
include  inconsistency  between  whst  people  say  they  will  do  and  actually  will  do 
plua  uncartainty  aa  to  consequences  of  acta  even  if  the  acta  are  as  anticipated. 

Form(s)  of  Output!  Tables  of  correlations  between  peychographic  specifics  or 
patterns  and  single  items  of  market  action  or  beliefa. 

Level  of  Detail i Detail  tends  to  be  middling  to  gross, 

Level  of  Confidence i Low  to  very  low.  Variance  data  aa  high  aa  501  is  unusual 
in  market  atudiea  and  seems  not  to  be  reported  at  all  for  social  atudiea. 

Span  of  Forecast!  Most  studies  have  focussed  on  the  short-term  (not  over  a 
year  or  so).  Applicability  of  psychographica  to  ioracasting  long-term  social 
trends  is  not  clear. 

HOW  DO  YOU  DO  IT? 

Procedures!  Individuals  respond  to  questionnaires  covering  the  areas  of 
Interest  to  the  researcher.  Correlations  are  then  run  and  variance  .data  derived. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability!  Main  requirement  la  for  a questionnaire 
of  proven  reliability  (i.e.,  whose  items  truly  reflect  the  issues  under  analysis). 
People,  Including  Organisational  Back-up;  Expartias  ia  required  in  questionnaire 
design,  statistical  analysis  of  results,  and  (often  most  important)  in  the 
generation  of  a conceptual  nodal  linking  psychographica  with  actions  and/or 
beliefs, 

Time;  Careful,  controlled  studies  require  a matter  of  months  although 
impressionistic  informal  surveys  cen  be  done  much  more  rapidly. 

Money : Costs  can  range  from  under  $1000  for  e quick,  impressionistic  spot 

survey  to  tens  of  thousands  of  dollars  for  careful,  extensive  research. 
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FORECASTING  EVALUATION  FORM  //I 


WHAT  IS  IT? 

Name:  ACTIVITIES,  INTERESTS,  OPINIONS  (AIO) 

Daf lnltion/dascrlptloni  A technique  for  forecasting  consumer  buying  (and 
other)  patterns by  correlating  an  Individual's  established  buying  habits  with 
his  activities,  interests,  and  opinions.  A special  form  of  life  style  or 
psychegraphic  research. 

Hiatory/degrae  of  provenness/promlse;  Developed  in  the  mid  1960s  by  Walla  and 
Tigert  o(  the  University  of  Chicago,  Leo  Burnett  Advertising  Agency,  and  Market 
Facts.  It  is  one  of  the  more  reliable  psychographic  techniques  of  egpeelal 
promise  In  market  research. 

WHAT  DO  ypU  GET? 

Uses  and  limitations;  Useful  in  forecasting  buying  patterns  of  many  kinds  of 
consumers.  Its  ability  to  forecast  social  attitudes  and  other  "soft"  issues 
is  not  established.  Limitations  include  variable  reliability  depending  on 
subject  being  forecast  and  apparent  severe  limits  on  degree  of  variance 
accounted  for. 

Form(s)  of  Output i Consumer  "profllea"  of  demographics  and  AIO  factors  and 
how  they  correlate  with  specified  consumer  behavior  (e.g.,  beer  consumption, 
use  of  detsrgent,  uss  of  toothpasta). 

Laval  of  Detail i Most  effectivsly  used  at  level  of  class  of  goods  or  action 
(beer  drinking  or  gardening)  but  AIO  can  be  employed  to  distinguish  between 
users  of  some  brands  within  a product  category. 

Level  of  Confidence!  Usually  low— often  very  low.  But  in  some  arses  (such  as 
Venial  consciousness)  AIO  plus  demographics  appear  to  account  far  over  half  the 
variance. 

Span  of  Forecast:  Duration  of  AIO  charactsriatics  is  not  dsfinitsly  aatablished 

but  probably  tends  to  be  many  years  for  a mature  individual. 

HOW  DO  YOU  DO  IT? 

Procedures:  The  individual  selects  statements  best  describing  him  from  some  300, 

supplies  demographic  information,  and  his  practices  with  respect  to  various 
advertising  media.  This  "profils"  is  than  correlated  with  his  actual  buying 
(or  attltudinal)  pattern  to  arrive  at  variance  data. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability!  Requirements  include  the  AIO  form,  know- 
ledge of  consumer's  buying  practices  in  the  area  of  interest,  and  capacity  to 
reach  the  consumer  to  administer  the  questionnaire. 

People.  Including  Organizational  Back-up:  Some  statistical  and  computational 

expertise  ia  required.  Access  to  consumer  panels  is  often  helpful. 

Time!  Done  informally  (e.g.,  with  walk-in  buyers  of  product)  a small  study 
can  be  completed  in  a week;  comprehensive  controlled  studies  require  several 
months  or  more. 

Money i Minimum  costs  are  the  investigator's  salary  for  a week  or  so;  elaborate 
studies  employing  consumer  panels  or  national  probability  samples  would 
probably  cost  at  least  $30,000. 
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FORK CAST INC  K VALUATION  FORM  #1 


Null  LIFE  WAYS 

Daflnltion/daecrlptloni  Thii  variation  of  paychographica  seeks  to  relate  th« 
innar  value* , image* , and  bellafa  of  poople  tn  thalr  attitude*  and  action*. 

Tho  at  tamp t la  to  go  daeper  than  the  typical  paychographic  approach  and  to 
connect  life  way*  with  fundamental  societal  node*.  Wall-known  life  way 
typologlea  Include  those  of  Maalow,  Erikaon,  Fromm,  Cravaa  (continued  next  page) 

Hlatory /degree  of  provannaaa/promlaai  In  a aanaa,  thia  ia  an  anclant  mode  of 
analyala  and  forecasting,  going  back  to  the  great  religious  writings  of  many 
faiths.  More  recently  many  developmental  theorists  have  uaed  the  concept  of 
atagea  of  growth  (l.e.,  changing  life  ways)  in  people  and  societies  to 
forecast  and/or  explain  underlying  societal  trands.  Polak  (continued  next  page) 

WHAT  DO  YOU  PET? 

Uses  and  limitations!  Life  ways  help  to  provide  normative  gestalts  (subjective 
description*)  of  plausible  alternative  futures,  help  aet  parameters  on  the 
timing  and  atagai  of  various  futures,  point  to  which  era  "good,"  and  suggaat 
much  about  the  economic,  social,  ate.  aapecta  of  societies  dominated  by 

(continued  next  page) 


Porm(e)  of  Output!  Scenarios. 

Level  of  Datallt  Tende  to  be  holistic  and  very  broad.  Middle-level  societal 
detail  can  aomatlmes  be  Inferred  from  life-way  deacriptiona . 

Level  of  Confldancei  Low  in  the  view  of  classical  aociologiata  and  hiatorian*. 
The  key  question  is  how  eelf-fulfllllng  is  e "vision  of  what  might  be." 

Span  of  Forecast i Usually  at  least  10  years  and  commonly  SO  years  or  more. 

Thia  approach  ia  especially  adapted  to  very  long-renge  societal  forecasting. 

HOW  DO  YOU  DO  IT? 

Procedures i Adopt  or  invent  a life  way  typology.  Interpret  past,  present, 
and  pleualble  future  events  in  terms  of  it.  Write  plausible  life  way  scenarios 
incorporating  documentable  trends  leading  to  the  various  futures. 

WHAT  DO  YOU  NEED? 

Date  reaulremente  end  availability:  knowledge  of  life  way  typologies  and 

how  atagea  within  a typology  connect  with  each  other  and  with  external 
societal  trends  and  characteristics. 

People.  Including  Organisational  Back-up t Life-wuy  forecast#  cen  be  done  by 
e single  individual  or  by  a team.  Library  and  research  assistance  is  helpfu.l 
but  not  essential. 

Time i A raasonsbly  careful  life-way  scenario  forecast  can  be  put  together 
in  a week.  Elaborate  scenarios  probing  details  take  much  longer. 

Money i Ranges  upward  from  1-week,  1-men  efforts. 
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LIFE  WAYS,  continued 


Deflnltlon/descriPtlon;  Rostov,  Kehlbsrg,  Morels,  and  Mitchell.  ParhapB 
the  bast  known  work  using  life  ways  as  the  bass  for  describing  a society 
in  McClelland's  Tha  Achieving  Society. 

History /dearea  of  provanness /promise i and  others  have  painted  to  the  key 
role  of  "images"  in  ^'creating  the  future."  The  approach  is  far  from  proven 
but  its  promise  is  considerable  in  preparing  macro-scenarios. 

Uses  snd  limitations  I specific  life  ways.  Limitations  are  that  life  ways 
are  more  powerful  descriptors  than  predictors,  although  some  believe  that 
tha  vidlon  of  a batter  life  way  is  the  key  to  attaining  it.  To  the  extent 
that  people  achieve  the  life  ways  they  desire,  this  approach  can  be  a good 
forecasting  method. 


FORECASTING  EVALUATION  FORM  II 1 


WATHm 

Naomi  HISTORICAL  ANALOGY 

Dsflnltlon/descriptloni  Used  in  both  social  and  technological  foracaatini,  tha 
approach  of  historical  analogy  aaaka  to  draw  parallala  betvaan  paat  avanta  and 
what  nay  occur  in  tha  futura.  Thua  growth  pattarni  in  foaail  fuala  for  1800-1960 
hava  baan  uaad  to  foracaat  tha  futura  of  nuclear  fuala.  Similarly,  tha  avanta 
aurroundlng  the  Protaatant  Reformation  hava  baeh  uaad  to  auggaat  tha  U.S.  today 
ia  on  the  brink  of  a parallel  aoclal  change. 

Hlatorv/daaraa  of  provannaaa/promlbai  One  of  tha  oldaat  tachnlquaa.  If  tanpared 
with  good  Judgment it  provide*  vary  uaaful  lnalghta  but  ganarally  not  detailed 
foracaata.  llsad  in  conjunction  with  atudiae  of  tha  forcaa  of  change  and  their 
machaniamat  the  approach  appaara  pronlaing. 

WHAT  DO  YOU  GET? 

Uaaa  and  llnltatlonai  Moat  uaaful  for  auggaating  likely  diractiona  of  macro 
tronda.  Limitations  are  that  avanta  saldom  repeat  themsalvas  exactly i in 
addition,  the  cauaal  relationship*  presumed  for  one  era  or  condition  may  not 
apply  in  other  clrcumatancaa,  no  matter  how  apparently  identical. 

Form(a)  of  Output!  Scenarios,  parallala j uaually  qualitative  rather  than 
quantitative. 

Laval  of  Detail i Usually  uxcaadlngly  grosa,  although  trends  of  medium  detail 
are  sometimes  identified  in  forecast*  based  on  historical  analogy. 

Level  of  Confidence!  Medium  in  term*  of  exact  forecasts;  high  in  terms  of 
providing  insight  into  plausible  alternative*. 

Span  of  Forecast i Medium  to  long— not  good  for  very  short-run  forecasting. 
|2WD0YWU01X? 

Procedures!  Find  parallel  conditions  in  another  country,  industry,  time  in 
history,  etc.  Argue  that  what  happened  elsewhere  or  before  ia  a sensible 
basis  for  expecting  a repeat  performance.  Adjust  "duplicate  forecast"  by 
judgment  based  on  Identifiable  difference  between  the  two  situations. 

WHAT  DO  YOU  NEED? 

Data  requirement*  and  availability i Knowledge  of  condition  being  forecast 
and  it*  commonalities  with  analogous  situations.  Data  on  historical  condition* 
is  often  vague  or  misunderstood  or  not  available. 

People,  Including  Organisational  Back-up;  Specialists  in  soeisl  chsnge; 
historians;  experts  in  the  area  being  forecast.  Imaginative  intellects  seem 
necessary. 

TLmei  Impressionistic  forecasts  basod  on  historical  anulogy  arc  often 
proposed  In  minutes;  carefully  documented  forecasts  require  months. 

Money;  Ranp,cn  from  very  little  to  major. 
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FORECASTING  EVALUATION  FORM  II 1 


WHAT  IS  II? 

Nana:  ALTERNATE  FUTURES— Field  Anomaly  Ralaxation  Method  (FARM) 

Deflnltlon/descrlptioni  Thia  la  a morphological  foracaating  method  heretofore 
uaed  mainly  to  describe  plausible  alternative  futures  for  the  U.S.,  although 
it  ia  adaptable  to  smaller  (regional,  industry,  etc.)  units.  Scenarios  are 
built  up  by  stringing  together  societal  "snapshots"  consisting  of  self- 
consistent  combinations  of  societal  elements  (assembled  via  "field  anomaly 
relaxation")  aelected  from  a systematically  designed  array  of  plausible 
possibilities. 

Hlstorv/dearea  of  provenness/promisei  Thia  particular  technique  has  been  used 
chiefly  at  Stanford  Research  Institute  for  identifying  plausible  U.S.  futures 
out  to  the  year  2000.  The  technique  forces  systematic  consideration  of  possible 
societal  configurations.  Ths  method  appears  promising,  especially  for  first- 
cut  identification  of  brood  future  scenarios. 

Uses  and  limitations i Best  adapted  to  comprehensive  societal  forecasting,  but 
Iii.ptabls  to  lesser  fields.  Very  helpful  in  broadening  perspectives  on  the  full 
range  of  possible  futures.  Limitations  include  fact  that  FARM  is  lees  predictive 
than  descriptive  or  analytic.  Plausibility  Judgments  are  highly  aubjactive. 

Form(«)  of  Outputi  Snapshots  of  socisties  strung  together  into  a time-oriented 
sequence— i.e. , a acanario. 

Leval  of  Detail!  Tends  to  be  exceedingly  broad.  Can  be  combined  with 
documented  trends  to  provide  more  detail. 

Level  of  Confidence i Technique  ia  lean  concerned  with  the  level  of  confidence 
to  be  placed  in  a given  scenario  than  it  la  with  describing  and  dating  the  main 
lines  of  plausible  future  evolution  of  the  subject  being  studied. 

Span  of  Forecaati  Most  work  to  date  hoe  focuiBed  on  3 to  30  yoars  ahead,  but 
thiH  range  could  be  reasonably  extended  to  SO  years  or  more.  FARM  is  not  well 
suited  for  short-range  forecasting. 

HOW  DO  YOU  DO  IT? 

Procedures:  (1)  Define  6 to  10  critical  components  of  the  subject  being  studied 
(e.R.,  for  U.S.  society!  economics,  technology,  values,  etc.)  and  array  of 
possible  conditions  In  each  component  (e.g.,  for  economics!  general  prosperity, 
limited  prosperity,  recession,  etc);  (2)  define  self-consistent  whole  societies 
combining  a single  condition  from  each  component  area;  (3)  string  together  into 
scenurloa  of  whole  societies  that  seem  plausible  within  forecast  period; 

(4)  date  main  stages. 

WHAT  DO  YOU  NEED 7 

Data  requirements  and  availability!  Thu  chief  requirement  is  a "feel"  for  how 
societies  fit  together — what  can  and  cannot  co-exist—  together  with  the 
imagination  to  picture  a wide  range  of  plausible  societies. 

People,  Including  Organisational  Back-up i In  addition  to  an  inventive  team 
sensitive  to  the  diverse  aspects  of  imagining  and  describing  societies,  there  is 

a need  for  much  note-taking,  draftLng,  and  rewriting.  Research  assistance  is 
essential  if  trends  are  to  be  documented  with  data. 

Time:  One  month  is  prohably  minimum  if  one  starts  from  scruteh;  six  months  is  a 
iifoYe  reasonable  expectation  for  a comprehensive  study. 

Money ! Costs  would  range  from  a low  of  a few  thousand  dollars  to  $100,000  or  more. 
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FORI' CASTING  EVALUATION  FORM  III 


WHAT  IS  IT? 

Nag w;  DIVERGENCE  MAPPING 

Daflnltlon/datcrlptlom  Thla  ia  a system  for  Judgmental  identification  of 
pious KIT  futura  aeanarioa  and  thalr  implications,  The  method  ia  applicable 
to  aodetal  forecasting  and  to  laaaar  unlta,  auch  aa  regions.  induatrlca,  or 
even  products.  The  technique  haa  ita  origin  In  morphological  modelling  and 
overlapa  aspect*  of  FARM,  both  of  which  are  deacrlbod  elaewhere. 

Hiatory/dearee  of  provenneaa/promlaai  Dlvargenca  Mapping  was  invented  in  the 
early  1970a  and  thue  far  haa  bean  uaed  for  atudylng  plausible  alternative  futurea 
for  corporatlona  in  several  Industries,  for  several  states,  etc.  The  method 
la  proven  in  the  sense  that  it  definitely  voblcs.  Exponents  of  the  method  feel 
that  it  promises  well  for  applications  in  many  untried  areas. 

WHAT  DO  YOU  GET? 

Uses  and  limitations!  Principal  uses  include  (1)  identification  of  "beat," 

''worst  / end  ''moot  likely"  futurea  for  an  organisation  or  area;  (2)  emphasis 
upon  strategic  planning  issues  inherent  in  different  kinds  of  futures;  (3) 
surfacing  of  assumptions  and  psrcsptlonn  concerning  today  and  the  future  by 
thoaa  ualng  tha  method.  Limitations  include  suppression  of  predicting  of 
forecaating  tha  futura  In  favor  analysis  of  the  plausible  and  possible. 

Fore(s)  of  Output:  Sketchy  scenarios  of  favorable,  unfavorable,  and  likely 
futurea  for  tha  organisation,  region,  or  product  under  study. 

level  of  Detain  In  gantral  the  datall  ia  vary  gross  although  certain  trends 
or  posalble  specific  events  usually  emerge  aa  requiring  detailed  attention. 

Level  of  Confidence!  The  confidence  to  be  placed  in  any  aptcific  alternative 
future  coming  to  paia  la  low;  confidence  placed  in  Divergence  Mapping  as  a 
method  of  introducing  planners  to  "futurea  thinking"  is  high. 

8pen  of  Foracaeti  Most  work  to  date  has  looked  ahead  25  or  30  yenra,  but  thie 
could  ba  extended  to  50  year*  or  more  by  altering  the  "frames"  fcee  bolow). 

HOW  DO  YOU  DO  IT? 

Procedures i (1)  Critical  issue*  for  the  organisation  (or  region)  understudy 
are  identified;  (2)  numerous  snapshots  ("frames")  of  societies  reflecting  these 
issues  are  written,  (3)  in  a 3-day  workshop  mambers  of  the  client  organization 
(a)  place  these  frames  in  tiers  ranging  from  "likely  to  happon  soon"  to  "rouiote 
in  time,"  (b)  string  frames  from  ths  tiers  together  into  "best,"  "worst,"  and 
"most  likely"  scenarios  for  the  future,  and  (c)  identify  strategic  planning 
issues  implied  by  each  scenario, 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability  Definition  of  critical  issues  for  the 
organization  are  required;  uaually  executives  in  the  organization  are  aware  of  these. 
People.  Including  Organizational  Back-up!  The  project  staff  must  be  able  to  write 
plausible  snapshots  of  societies  reflecting  various  critical  issues;  the  organiz- 
ation must  be  willing  to  free  some  of  its  senior  staff  for  s 3-day  workshop. 
Reportorlal  requirements  arc  medium. 

Time:  Six  weeks  is  minimum  from  start  to  finish;  three  to  four  months  is  a 
more  reosonable  schedule. 

Money)  In  the  form  described  above,  costs  nver.ige  ubout  $15,000,  Inclusion  of 
detailed  data  back-up  for  trends  incorporated  in  the  "frames"  will  increase  the 
cost.  Cost  will  be  reduced  if  off-the-sholl  frames  are  utilized  in  the  workshop. 
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FORECASTING  EVALUATION  FORM  91 


WHAT  IF  IT? 


game!  INTROSPECTIVE  FORECASTING 

Definition/ description:  This  approach  involves  the  creation  of  inner  pictures 

of  the  future.  It  night  be  called  "prescience,"  "clairvoyance,"  "zen  fore- 
casting," or  "vision  foresight." 

History/degree  of  provenneBB /promise!  This  1b  easily  the  most  ancient  node 
of  forecasting,  going  back  to  soothsayers,  the  reading  of  tea  leaves,  the 
Delphic  oracles,  I-Chlng,  and  aimilBr  occult  arte,  Nostradamus  was  a famous 
practitlonar  of  this  mode  of  looking  ahead.  The  method  is  bo  far  from  proved 
that  its  promise  is  negligible  in  the  absence  of  a methodological  breakthrough. 

WHAT  DO  YOU  GET? 

Uses  and  limits tlonsi  Approach  la  useful  to  elicit  the  thinking  of  "mystics" 
or  others  who  have  trouble  working  In  more  systematic  modes.  Limitations 
are  that  forecasts  are  often  ambiguous,  their  origins  are  seldom  traceable, 
and  they  are  usually  very  fragmentary  (deal  with  but  one  of  many  aspects  of 
a situation). 

Forru(s)  of  Output!  Scenarios,  epigrams,  parableB,  stories,  "visions,"  dreams, 
pictures. 

Love!  of  Detail!  Range  from  the  universal  ("end  of  world"  forecasts)  to  very 
specific  (earthquake  of  X magnitude  Qt  Y place  at  Z time). 

Level  of  Confidence:  Forecasts  arc  almost  completely  uncheckable  by  normal 

means.  Forecasts  of  specific  future  events  (e.g.,  earthquake)  have  proved 
about  100'/  wrong. 

Span  of  Forecast!  Range  from  near  term  literally  to  eternity. 

HOW  DO  YOU  DO  IT? 

Procedures!  Introspective  forr.i  .sting  is  an  art  and  as  such  is  done  differently 
by  most  practitioners.  Techniques  such  as  meditation,  certain  games,  psychedelic 
drugs,  biofeedback,  yoga,  etc.,  often  help  in  producing  this  kind  ol  forecasting. 

WHAT  DO  YOU  NEED? 


Data  requirements  and  availability:  No  data  requirements. 

People,  Including  Organization,.  1 Back-up:  Such  forecasters  usually  work  in 

Isolation . 

Time:  These  forecasts  often  occur  of  themselves  rather  than  emerge  on  command. 

Money : Often  free;  if  not  an  honorarium  may  be  involved. 
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FORECASTING  F.VALUTION  FORM  til 


WHAT  IS  IT? 

Name:  UTOPIAS/DYSTOPIAS 

Definition/description:  These  are  (usually  fictionalized)  accounts  of  glorlou'- 

or  terrifying  aocletias.  Commonly  some  satire  la  involved.  Utopias  and 
dystopias  ^iffe?  from  science  fiction  in  tending  to  treat  the  whole  of  society 
and,  perhaps,  in  being  a bit  less  fanciful. 

History/degree  of  provenness/promise:  Thin  form  of  forecasting  is  very  old, 

going  back  at  least  to  ancient  Greece.  Some  of  the  genre  are  considerad  to 
have  bean  very  useful  socially  as  satire  or  as  a warning  of  things  to  watch 
out  for.  In  general,  they  have  not  bean  taken  seriously  as  forecasts, 

WHAT  DO  YOU  GET? 

Uses  and  lln Stations i Very  useful  as  "freeing''  devices  to  spur  normative 
thinking  about  where  a society  wants  (or  doesn't  want)  to  go.  As  forecasts 
most  utopias  and  dystopias  are  unsystematic  and  also  fail  to  deal  with  how 
today  ml^ht  turn  Into  the  pictured  condition. 

Form(s)  of  Output:  Usually  in  fictionalized  narrative. 

Laval  of  Detail:  Cover  the  gamut  from  global  to  highly  epecific. 

Level  of  Confidence!  Confidence  in  utoplas/dyatopiae  is  low  ae  forecasts 
of  what  will.  be;  ae  conceivable  (if  not  predicted)  futurea  they  are  often 
highly  convincing.  Actually,  purpose  of  some  dystopiua  (e.g.,  1984)  ie 
essentially  to  help  that  futuro  net  come  into  being. 

Span  of  Forecast:  Not  applicable  in  moat  cases. 

HOW  DO  YOU  DO  IT? 


Procedures:  WritiaR  of  fiction. 

WHAT  DO  YOU  NEED? 


Data  requirements  and  availability:  None. 

People,  Including  Organizational  Back-up:  Just  Bn  author,  who  seldom  works 

within  an  organizational  framework. 

Time:  Not  applicable. 

Money:  Not  applicable. 
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FORECASTING  EVALUATION  FORM  ill 

WHAT  IS  IT? 

Name!  MODES  AND  MECHANISMS  OF  SOCIAL  CHANCE 

Daf lnition/desctlption : This  approach  Make  Co  forecast  the  tlmingi  direction) 
nature,  and  magnitude  of  social  change  through  analysis  of  mechanisms  and  patterns 
of  change.  These  include  such  phenomena  as  discontinuities,  collision  trends, 
new  perceptions  and  prioritiea,  diffusion  patterns,  change-over  points,  etc. 

Hietory/dearee  of  provannass/promlsai  This  kind  of  thinking  is  used  implicitly 
by  many  forecasters  but  it  has  seldom  been  systematised  and  related  to  change 
in  various  sectors  of  the  society.  The  approach  appears  promising  in  that  it 
would  markedly  enrich  and  refine  forecasts  derived  by  other  means  (especially 
scenarios). 

WHAT  DO  YOU  GET? 

Uses  and  limitations!  The  approach  probably  applies  most  usefully  to  social 
change  although  it  has  also  bean  applied  effectively  to  technological  forecasting. 
Limitations  include  present  undeveloped  state  uf  the  approach  and  fact  that  it  is 
not  applicable  to  purely  physical  issues,  such  as  weather,  resource  supplies,  etc. 

Form(e)  of  Output;  Models  relating  change  mechanisms  to  specific  areas,  such 
as  social  disruption,  awareness  of  issues,  conflicts  of  interest,  "ideas  whose 
time  hse  come." 

Level  of  Detail;  Very  broad,  although  perhaps  expressed  in  probabilistic 
mathematics. 

Level  of  Confidence!  Medium  to  low  at  present:  level  might  be  raised  by  more 
sophisticated  research. 

Span  of  Forecast i Beet  for  medium  (5  years)  and  longer.  The  approach  promises 
well  for  very  long-range  forecasting  (50  years  and  more). 

HOW  DO  YOU  DO  IT? 

Procedures!  One  studies  the  apparent  reasons  for  past  change  in  the  area  of 
intsrsst.  Using  theBe  data,  models  are  constructed  and  tested  in  similar  con- 
ditions elsewhere.  By  analogy  or  directly  these  insights  and  relationships  as 
applied  to  current  issues,  facilitating  forecasts  of  when,  where,  how,  and  how 
much  change  is  to  be  anticipated  over  specified  time  periods. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability:  Enough  data  la  required  to  Justify  an 
intuitive  or  mathematical  model  of  the  phenomena  of  interest.  Often  the 
available  data  are  fuzzy  and  soft. 

People,  Including  Organizational  Back-up;  Key  need  is  for  imaginative  aociBl 
generalists  knowledgeable  about  where  to  obtain  detailed  data  If  they  are 
required.  The  technique  could  be  computerized,  although  that  probably  isn't 
justified  at  present. 

Time!  Intuitive  models  of  change  mechanism**  can  often  be  sketched  in  a day. 
Detailed  back-up  and  documentation  takes  much  longer. 

Money!  Useful  work  can  be  done  for  less  than  $1000.  Original  and  comprehensive 
description  oi  the  principal  change  processes  entering  a complex  social  system 
might  cost  $250,000  or  more. 
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FORECASTING  EVALUATION  FORM  II 1 


WHAT  IS  IT? 


Nanai  STUDY  OF  FORCES  OF  CHANGE 

Deflnltlon/deacriptlon!  Instead  of  looking  at  historical  trends  and  events , 
the  forecaster  axanines  the  forces  underlying  trends  and  aventa,  such  as  growth 
processes,  changing  values,  social  conflicts,  or  shifting  emphasis  In  education, 
R&D,  or  acceptance  of  new  ideas.  In  forecasting  on  the  baala  of  change-generating 
forces,  the  researcher  uses  many  techniques,  such  as  precursor  events,  social 
surveys,  cross-impact  analysis,  etc. 

History /degree  of  provennssa/pronlsti  This  approach  has  been  extensively  used 
by  social  historians  and  philosophers  but  it  has  not  yst  been  systematised  into 
a specific  methodology.  The  method  has  much  promise  although  it  is  too  early 
to  assess  prospects  for  major  improvements  in  societal  forecasting. 

WHAT  DO  YOU  GET? 

Uses  and  limitations!  Useful  for  separating  symptoms  from  causes.  The  approach 
is  applicable  to  broad-gauge  of  spacific  forecasting.  Limitations  include 
an  undeveloped  state  of  the  art  and  uncertain  caus>  .'effect  relationships  in 
many  fields. 

Form(a)  of  Output!  Complex  scenarios  indicate  emerging  change  forcee  and 
their  probable  consequences  for  the  future. 

Level  of  Detail i Tends  to  be  broad. 

Level  of  Confidence!  Not  clear  because  technique  is  very  undeveloped. 

Span  of  Forecast!  Emphasis  on  long-term— 10  years  and  upi  approach  is  well 
adapted  to  very  long  rango  forecasting. 


HOW  DO  YOU  no  IT? 

Procedures!  (11  Identify  the  koy  physical,  organizational,  ideological  elements 
underlying  the  field(s)  to  be  forecast;  (2)  forecast  trends  in  these  areas; 

(3)  develop  implications  and  effects  in  terms  of  tho  study  field;  (A)  cross- 
check with  forecasts  derived  in  other  ways. 

WHAT  UP  YOU  NEED? 

Data  requirements  and  availability!  Deop  knowledge  of  change  forces  along 
with  motlel(s)  linking  underlying  cause  witli  external  events  being  forecast. 

People,  Including  Organizational  Back-up:  Area  specialists,  Bocial  theorists 

(to  devise  model),  scenario  writers.  Computer  manipulation  of  models  is 
sometimes  helpful. 

Time!  A month  would  he  minimum  for  a limited  study;  major  societal  studies 
could  easily  take  u year  or  more. 

Money  ! $5000  and  up. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 


Name:  MACRO  HISTORICAL  CYCLES 

Definition/ description:  In  the  view  of  many  hiatoriana,  natione  paai  through 
diatlnct  stages  or  cycles  in  their  evolution-cyclee  that  tend  to  repeat  them- 
selves. Toynbee,  Sorokin,  Spengler,  and  Marx  have  discussed  such  cycles.  The 
existence  of  recognisable  cycles  and  an  understanding  of  how  and  when  stages 
emerge  provides  a powerful,  if  very  general,  societal  recasting  tool. 

Hlstory/dagrea  of  provennesa/promlsei  The  approach  is  classic.  Currently,  the 
numerous  futurists  who  see  the  U.S.  as  on  the  verge  of  a "new  epoch"  usually 
draw  comparisons  with  times  past,  although  they  may  not  sea  it  as  a repetitive 
process.  The  promise  of  this  approach  depends  on  one's  sense  of  how  much  history 
repeats  itself  vs.  how  fundamentally  different  today's  world  is  from  any  past 
situation  > 

WHAT  DO  YOU  GET? 

Uses  and  limitations:  Like  other  approaches  based  on  historical  analogy,  this 
one  le  an  excellent  starting  point  and  heuristic  for  forecasting.  Limitations 
are  severe  because  the  approach  excludes  the  potential  of  a nation  moving  ahead 
to  a form  "beyond"  anything  known  to  history  and  hence  noncycllc. 

Form(s)  of  Output:  Scenarios  that  extensively  utilise  historical  precedent. 

Level  of  Petal! : Extremely  general  and  gross.  SubscenarioB  within  the  macro 
change  can  deal  with  finer  detail. 

Level  of  Confidence:  In  general  the  confidence  level  le  medium  on  the  generic 
level  and  low  on  spec if ice. 

Span  of  Forecast:  Tends  to  be  very  long  range— up  to  100  years  or  more. 

HOW  DO  YOU  DO  IT? 

Procedures:  One  invents  or  adopts  a theory  of  national  evolution.  (Sorokin's 
goes  from  Sensate,  to  Late  ScnBate,  to  IdeatlonBl,  to  Integrated,  back  to 
SenBate.)  The  nation  under  study  is  described  in  terms  of  the  model  end  thus 
placed  in  the  cycle.  Inferences  are  then  made  about  when  and  how  the  country 
will  enter  the  next  phase,  etc. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability:  Considerable  requirements  for  historical 
data  to  butress  the  cycle  model— which  is  often  unobtainable  except  by  inference- 
plus  data  on  the  nation  under  study. 

People.  Including  Organisational  Back-up:  Historians  and  expertB  in  social 
change  are  the  principal  requirements. 

Time:  An  impressionistic  first  cut  can  be  done  in  a week  or  two.  Detailed 
analysis  and  attitudinal  comparisons  require  many  months,  if  not  years. 

Money:  First  cuts  might  cost  a few  thousand  dollars,  Major  documented  studies 
would  he  very  expensive. 


FORECASTING  EVALUATION  FORM  //I 
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myyi? 

Nams;  CROSS-CULTURAL  COMPARISONS 

D«f Ini t ion/ descript ion;  This  important  variant  on  hiatorical  analogy  (described 
alatwhera)  depends  on  the  idea  that  what  people  do  in  givan  circumstance*  is 

pretty  much  the  sane  all  over  the  world  (or  nation).  Thus  it  is  said  that  what  j 

happens  in  the  U.S.  will  occur  in  England  and  Europe  3-6  years  later.  Cross- 
cultural  comparison*  systematise  and  quantify  this  approach. 

History /degree  of  provtnneas/promisei  Root*  of  this  approach  lie  in  anthro- 
pology and studies  of  stage*  of  growth  of  nations.  More  recently  elaborete 
cross-national  studies  have  basn  made  not  only  of  GNP,  education,  population, 
productivity,  etc.,  but  of  values  and  social  priorities.  The  relationship  of 
specific  indices  and  social  change  is  roughly  established,  but  much  remeins 
to  be  done  to  devise  truly  reliable  models. 

mT|gjouOT? 

Uses  and  limitations i Cross-cultural  comparisons  ars  useful  as  indicators  of 
possible  future  trends,  but  at  present  they  are  little  more  than  that.  Lack 
of  conaiatent  correlation*  plus  differing  national  styles  severely  limit  the 
approach. 

Porm(a)  of  Output i Historical  accounts  Incorporating  surrounding  trends.  Some 
studies  present  parallel  data  for  many  nations,  allowing  direct  comparisons. 

Level  of  Detail i Detail  is  usually  of  middling  level  (a.g.,  number  of  cars, 
birth  rate,  QNP,  etc.) 

Level  of  Confidence!  Not  high  at  present  state  of  the  art,  except  for  the  most 
global  trends  (i.e.,  a nation  is  at  "take-off  stage,"  or  is  reaching  a 
"mass  economy.") 

Span  of  Forecast!  Speculations  range  to  50  yeara  and  more  ahead. 

HOW'  DO  YOU  DO  IT? 

Procedures!  Devise  a social  development  model  correlating  specified  Indices  with 
development  changes.  Apply  what  seems  to  hold  for  one  nation  (or  region)  to  a 
nation  (or  region)  at  an  earliar  stage,  Forecast  change  on  the  basis  of 
parallelism,  adjusted  by  subjective  judgment. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability!  Parallel  data  for  many  nations.  Useful 
data  are  often  not  available  or  not  reliable  or  not  parallel.  UNESCO  studies 
■re  improving  tha  situation.  Sometimes  nscessary  to  collect  original  dsts. 

People.  Including  Organizational  Back-up;  Research  calls  for  sociologists, 
economists,  statisticians,  historians,  and  often  others.  Computers  for  model 
divelopment  and  manipulation  are  almost  essential. 

Time!  Any  appreciable  study  will  take  months,  if  not  a year  or  more. 

Honey;  Very  little  can  be  done  for  leas  than  $25,000.  Any  study  requiring 
new  data  will  for  exceed  $100,000. 
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FORECASTING  EVALUATION  FORM  III 
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WHAT  IS  IT? 

Name i SYNECTICS 

Definition /description:  Synectlce  la  an  approach  to  inducing  creative  thinking, 
which  may  be  applied  to  inventing  products,  social  issues,  alternative  futures, 
etc.  Thinking  in  analogies  plays  a major  role  in  the  9-step  process  defined 
as  Synectics.  The  system  might  be  an  aid  to  forecasting!  it  does  not,  in 
itself,  produce  forecasts. 

History /degree  of  provennass/promisei  Developed  largely  by  W.J.J.  Gordon  in  | 

the  1960s,  Synectics  has  proved  very  helpful  in  solving  a variety  of  mechanical  j 

and  people  problems  in  industry,  The  technique  might  also  be  applicable  to  | 

solving  social  insues  or  to  inventing  ways  to  "create"  the  future. 

WHAT  DO  YOU  GET?  ! 

Uses  and  limitations  I The  technique  forces  imaginative,  non-routine  thinking  3 

about  (usually  old)  problems  and  often  comes  up  with  "inspired"  solutions.  J- 

By  no  means  always  successful,  the  methods  when  applied  to  forecasting  and  i 

social  issues  would  probably  prove  stimulating  rather  than  analytical.  i 

Form (a)  of  Output  I Clarified  problem  statements  with  one  or  more  approaches  1 

to  solution,  j 

Level  of  Detail t Often  exceedingly  detailed.  .■ 

Level  of  Confidence!  Ranges  from  clear  solution  to  the  problem  (1002  con-  1 

fidence)  down  to  failure.  1 

Span  of  Forecast!  Not  applicable.  Synetics  might  help  inveatigators  envision 

the  future  more  clearly  or  invent  approaches  to  solving  some  aocletal  issues 

but  it  is  not  intended  aa  a means  of  making  actual  forecasts.  ! 

HOW  DO  YOU  DO  IT? 

Procedures i Under  the  direction  of  i leader,  a group  analyzes  a apecific 
problem,  thinks  about  it  in  terms  of  several  analogies,  examines  possible 
solutions,  and  "force-fits"  these  to  the  specifics  of  the  problem. 

WHAT  DO  YOU  NEED? 


Data  reculrements  and  availability!  Data  on  the  problem  and  prior,  unsuc- 
cessful approaches  to  its  solution. 

People,  Including  Organizational  Back-up:  A group  leader  familiar  with 

Synectics  is  required  along  with  people  willing  to  try  out  fresh,  "weird" 
approaches  to  solving  problems.  The  organization  must  be  willing  to  try 
the  unusual. 

Time i Minimum  of  a few  weekB. 

Money;  Instruction  manuals  are  available  for  do-it-yourself  Synectics  sessions. 
Costs  will  be  largely  for  salaries.  Courses  in  Synectics  are  also  available. 
Synectics,  Inc.  will  also  conduct  sessions  on  specific  problems  for  fees  of 
about  $3000. 
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FORECASTING  EVALUATION  FORM  II 1 


WHAT  IS  IT? 

Name:  BRAINSTORMING 

Definition /description!  In  this  technique  for  evoking  creative  thinking, 
a group  (rarely  an  individual)  accepts  a very  precise  problem  and  comes  up  with 
as  many  ideas  as  possible  concerning  its  solution.  Every  idea,  no  matter  how 
remote,  is  accepted.  Success  of  the  method  deems  to  depend  on  the  freedom  and 
imagination  used  in  inventing  ideas.  Only  at  a later  stage  are  the  ideas 
tested  for  practicality.  Synectics  is  a more  structured  variant  of  brainstorming. 

History/degree  of  provenness/promlsei  An  old  technique  systematised  during 
the  1930s  in  Industrial  and  academic  settings.  Results  are  varied,  with  a 
very  few  outstanding  successes.  In  general  brainstorming  is  less  popular  than 
it  once  was.  Now  used  mostly  as  an  aid  to  analysis  and  decision-making. 

WHAT  DO  YOU  GET  7 


Uses  and  limitations!  Especially  good  for  long-term  furucaets  with  a big 
normative  component.  For  some  purposes  (classified,  military,  etc.)  "opera- 
tional creativity"  is  used  in  which  the  exact  nature  of  the  problem  is  known 
only  to  the  leader,  who  takas  an  active,  directive  role.  Limitations  are 
the  unsystematic  results  and  the  lack  of  documentation. 

Form(s)  of  Outputi  Statements  of  ideas,  possibilities,  approaches,  forecasts. 

Level  of  Detail i Tends  to  be  general,  but  can  be  very  detailed  If  the  brain- 
stormers  are  specialists  in  the  field. 

Level  of  Confldancei  Erratic— an  occasional  "breakthrough"  idea. 

Span  of  Forecast i Can  be  for  any  period;  the  technique  ie  well  adapted  to 
long-range  forecasting. 

HOW  DO  TOU  DO  IT? 


Procedures:  A group  freely  discusses  a problem  from  many  angles,  an!  comes  up 
with  large  numbers  of  different  approaches  or  solutions,  The  (doubtful)  theory 
la  that  the  more  ideas  the  greater  the  likelihood  of  a solution. 

WHAT  DO  YOU  NEED? 


Data  requirements  and  availability!  Requirements  for  data  come  after  the 
brainstorming,  to  check  the  praticallty  of  proposed  solutions. 

People,  Inrludlna  Organisational  Back-upi  Needed!  Inventive  panel  members 
generally  or  specifically  expert  In  the  subject  being  studied;  a leader  able 
to  ask  evocative  questions  and  free  people  of  Inhibitions;  a recorder  and 
aummarlser. 

Timet  Brainstorming  sessions  cbo  laBt  a morning,  a day,  or  a week  (in  the 
case  of  large  groups  discussing  a variety  of  interrelated  problems). 

Money ; Basically  on  inexpensive  technique;  salaries  are  the  principal  coat 
element . 
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FORECASTING  2 VALUATION  FORM  111 


WHAT  IS  IT? 

Names  BIONICS 

Definltlon/deacrlptlon s Bionics  is  the  atudy  of  social  or  mechanical  systems 
through  analogy  of  living  ayaeama.  (Cybernetics  la  the  reverse.)  Beat  known 
aa  an  approach  to  inventions  (bat's  hearing  led  to  radar,  etc.),  bionics  also 
have  applications  in  societal  development  (parallels  with  individual's  growth), 
social  and  organisational  models  (biological  growth,  entropy,  etc.),  etc. 

Hlstory/degree  of  provenness/promlaei  Bionics  la  a post-war  development  that 
has  produced  spectacular  successes  in  dealgning  or  inventing  mechanisms.  Its 
use  in  social  analyaia  and  forecasting  is  much  less  developed  except  in  the  use 
of  biological  growth  curves  to  forecast  rates  of  future  change.  A promising 
area  la  parallelism  between  change  in  individuals  and  that  in  societiea  and 
organizations. 

WHAT  DO  YOU  GET? 

Uses  and  limitations!  Bionics  la  moat  useful  as  an  idea  generator;  usually  it 
does  not  result  in  explicit  foretaste.  The  approach  auffera  from  the  inexacti- 
tudes of  any  analogy. 

Form(s)  of  Output;  Di ver a e—  growth  curves,  models,  scenarios,  etc. 

Level  of  Detail!  Often  applied  to  very  exact  technical  problems,  but  for 
social  or  marker  forecasting  the  level  of  detail  tends  to  be  medium  (sales 
have  pasaed  region  of  highest  growth;  it  is  unreasonable  to  expect  the 
speed  of  aircraft  ever  to  exceed  X). 

Level  of  Confidence!  Depends  wholly  on  the  situation. 

Span  of  Forecast!  In  general,  span  1b  medium  to  long;  the  techni  (ue  is  not 
well  adapted  to  very  short-term  forecasts. 

WHAT  DO  YOU  NERD? 

Data  requirements  and  availability!  Vary  enormously.  Intuitive  understanding 
1b  sufficient  in  some  cases. 

People,  Including  Organizational  Back-up;  Inventive,  creative  minds  are  the 
key  ingredients. 

Tiroes  Growth  curves  can  he  usefully  applied  very  rapidly;  sophisticated 
natural  models  require  much  longer. 

Money:  To  use  existing  bionic  techniques  is  inexpensive;  to  advance  the 

state  of  the  art  would  be  costly,  perhaps  $50,000  and  up. 
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FORECASTING  EVALUATION  FORM  01 


WHAT  IS  IT? 

Name!  SCIENCE  FICTION  AS  FORECASTS 

Deflnltlon/dascrlptloni  Science  fiction  writeri  over  the  laet  century  have 
projected  a variety  of  futuree  usually  in  a holistic  context,  Their  insights 
can  be  useful  as  an  adjunct  to  fornal  forecasting,  particularly  aa  an  early 
warning  device. 

Hiatory /degree  of  provenness /promise!  Some  writers,  Verne,  Wells,  Clark  have 
been  remarkably  adept  at  foreseeing  new  technology.  Orwell's  specter  of 
1984  has  been  useful  in  the  era  of  Watergate. 

WHAT  DO  YOU  GET? 

Uses  and  limitations!  Useful  in  forming  a preceptual  context  for  forecasting. 
With  rare  exceptions,  however,  it  contains  primarily  wishful  or  fearful  thinking 
rather  than  well  thought  out  analysis. 

Form(s)  of  Output:  Novels,  short  stories,  filma. 

Level  of  Detail!  Very  broad,  usually  whole  societies. 

Level  of  Confidence;  Suggestive  of  ideas  and  developments. 

Span  of  Forecast!  From  a few  years  (On  the  Beach)  to  the  far  future 
(Childhood1*  End) . 

HOW  DO  YOU  DO  IT  7 

Procedures!  Identify  on  a regular  basis  the  few  good  science  fiction  books 
published  and  read  as  general  background. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability i None, 

People,  Including  Organisational  Back-up!  Someone  who  Is  familiar  With  the 
literature  can  be  helpful  In  suggesting  the  better  works. 


Time!  Little,  just  reading  time. 
Money : The  cost  of  the  books. 


FORECASTING  EVALUATION  FORM  til 


WHAT  IS  IT? 


Nanai  EXPONENTIAL  SMOOTHING 

Daflnition/dtacrlptlons  Lika  moving  averages,  hiatorical  data  provides 
average  which  bacomei  forecast  value.  Different  in  that  more  recent  data 
la  given  lncraaaing  weight. 

History /dears*  of  provennen/oramlae;  Widely  ueed  for  short-term  forecasts, 
where  pattern  of  data  is  regular  and  no  major  changes  anticipated. 

WHAT  DO  YOU  GET? 

Uses  and  limitations!  Is  a little  more  accurate  than  moving  averages,  but 
only  useful  lor  very  orderly  data. 

Fornfs)  of  Output!  Quantitative  data  for  neat  time  period. 

Level  of  Detail i Forecast  ox  a single  quantity. 

Level  of  Confidence!  High  confidence  with  a regular  pattern. 

Span  of  Forecast i Equal  to  the  equal  intervals  of  the  historical  data. 

HOW  DO  YOU  DO  IT? 


Procedures!  Determine  weighting  coefficient  (•*)  on  basis  of  historical  data 
and  solve  equation  St  + i ■ gfc  + «<(xt  - St)  St  - forecast  for  time  t 

X,  ■ actual  value  at  time 


0<m  weighting  coefficient 


WHAT  DO  YOU  NEED? 


Data  requirements  and  availability!  Historical  data  over  at  lease  three 
equal  time  periods. 

People.  Including  Organizational  Back-up;  Requires  no  sophisticated  skill, 
but  Is  often  computerized. 

Time;  Very  quick. 

Money:  Low  cost. 
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FORECAST  INC  EVALUATION  FORM  ft 

WHAT  IS  IT? 

Name:  SIMPLE  RKCRESSION 

Deflnitlon/descript Ion!  A linear  algebraic  relationship  la  defined  between 
two  variables.  The  statistical  method  of  leant  squares  is  used  to  determine 
the  equation  of  the  relationship. 

Ilistory/degrec  of  provennegs/promlae:  Very  widely  need,  when  t linear 
pattern  is  Identifiable. 

WHAT  DO  YOU  GET 7 

Uses  and  limitations!  May  be  used  when  there  are  sufficient  historical  data 
to  define  the  "linearity  of  the  relationship. 

Form(s)  of  Output!  Quantitative  forecast  of  specific  values  over  any  period 
into  the  future, 

level  of  Detail!  Deals  with  only  two  variables. 

level  of  Confidence!  High  confidence  when  linearity  le  of  a long  deration 
and  there  ere  no  expected  events  which  may  modify  the  relationship. 

Span  of  Forecast*  No  limit. 

HOW  DO  YOU  DO  IT? 

Procedures:  Historical  data  is  collected,  least  squares  applied  to  determine 

coefficients  of  regression  equation,  equation  solved  for  desired  time  span. 

WHAT  DO  YOU  NEED 7 

Data  requirements  and  availability i Accurate  historical  data  of  any  interval 
and  a fair  number  ol  points. 

People,  Including  Orennimitional  Bnck-upi  Requires  some  statistical  expertise, 
usually  involves  computers.  " 

Time:  Relatively  quick. 

Money:  Can  be  expensive  if  data  collection  is  difficult  cost  of  computer 

time. 
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FORECASTING  EVALUATION  FORM  01 


WHAT  IS  IT? 

Name;  MOVING  AVERAGES 

Deflnitlon/descrlptlon;  Uses  historical  data  which  is  "smoothed."  Extremes 
are  discarded  by  averaging.  Average  of  the  known  values  becomes  the  forecast 
for  the  next  time  period.  When  that  becomes  a known  value,  average  is  re- 
calculated for  the  next  forecast,  hence,  moving  average. 

History/degree  of  provenness/promlBei  Very  old  technique.  Anticipated  error 
can  be  very  precisely  determined.  Widely  used  In  operational  forecasting. 

WHAT  DO  YOU  GET? 

Uses  and  limitations!  Limited  to  one  time  period  into  the  future — time 
period  determined  by  historical  data  i.e.  if  data  1b  every  five  years  then 
can  forocaet  five  years  into  future.  Cun  only  be  revised  at  end  of  time 
period.  Useful  when  historical  pattern  is  simple.  Little  variance  and 
change  is  nearly  linear. 

Form(s)  of  Output i Quantitative  value  for  next  time  period. 

Level  of  Detail!  Can  forecast  only  n single  quantity. 

Level  of  Confidence;  If  pattern  is  very  regular— little  variance— then 
confidence  is  high, 

Span  of  Forecast!  Determined  by  time  periods  of  historical  data. 

HOW  DO  YOU  DO  IT7 

Procedures ; Calculate  average  of  known  vbIucb  - recalculate  at  end  of 
forecast  period  using  new  known  value. 

u , , _ Xt  Xt-N  . e s " forecast  for  time  t 

st  + 1 TT  ' ”"n"  St  1 

Xt  ■ actual  value  nt  time  t 
N " number  of  values  Included  in  the  average 


W1JAT,  DO  YOU  NEED? 

Data  requirements  and  .availability;  Historical  data  over  at  least  three 
equal  time  periods. 

Time!  Very  quick,  conditioned  only  by  data  availability. 

Money;  Very  inexpensive. 
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FORECASTING  EVALUATION  FORM  01 


WHAT  IS  IT? 


Name;  MULTIPLE  REGRESSION 

Definition /description;  A linear  algebraic  relationship  la  defined  among 
several  variables  Including  the  one  to  be  forecast.  Least  squares  la  applied 
to  historical  data  to  solve  the  equation, 

Hlstory/dearse  of  provanness /promise i Very  widely  used  when  a linear 


relationship  Is  present. 

WHAT  DO  YOU  CET7 

Uses  and  limitations!  May  be  used  when  there  is  sufficient  historical  dutu 
to  assure  the  linearity  of  the  relationship  umong  the  ueveral  variables. 

Rormfs)  of  Output i Quantitative  forecasts  of  a single  variable. 

Level  of  Detail;  Can  deal  with  multiple  variables,  but  forecast  only  one. 

Level  of  Confidence!  High  confidence  when  the  historical  relationships  are 
well  established  by  standard  statistical  testa. 

Snan  of  Forecast!  No  limit. 


HOW  DO  YOU  DO  IT? 

Procedures:  Least  squares  method  applied  to  historical  data  to  apeclfy  co- 

efficients of  the  regression  equation.  Equation  is  then  solved  for  desired 
time  span. 

WHAT  DO  YOU  NEED? 

Data  rcqulrementa  and  aval lability!  Requires  extensive  historical  data. 

People,  Including  Organizational  Back-up!  .Sophisticated  statistical  skills 
and  computer. 

T line ! Alter  data  collection,  time  to  produce  .'orecust  la  brief. 

Honey ! Can  be  costly  in  computer  time. 


FORECAST INC  EVALUATION  FORM  #1 


WHAT  IS  IT? 

Name ; ENVELOPE  CURVES 

Deflnition/descriptlon:  It  is  a method  using  the  envelope  crested  by 

earlier  data  to  predict  the  rate  of  development  In  a particular  area  of 
technology. 

History/degree  of  provenneas/promina:  Very  widely  used  and  proven  in 

limited  applications. 

WHAT  DO  YOU  GET? 

Uses  and  limitations;  Can  predict  the  advance  of  a particular  technological 
parameter  e.g.,  speed,  but  not  the  nature  of  new  technology,  cannot  account 
for  major  breakthroughs. 

Form(s)  of  Output:  Quantitative  forecast  of  single  parameter. 

Level  of  Eetaili  Single  parameter. 

Level  cf  Confidence;  High  when  envelope  is  consistent  over  long  periods 
of  time. 

Span  of  Forecast:  Limited  by  anticipated  parameters  of  new  technology. 

HOW  DO  YOU  DO  IT? 

Procedures:  A series  of  "S"  curves  is  developed  to  define  the  envelope. 

The  limits  of  the  envelope  define  the  limits  of  the  forecast  "S"  curve. 

WHAT  DO  VO'J  NEED? 

Data  requirements  and  availability:  Extensive  historical  data. 

People,  Including  Organizational  Hack-up:  Sophisticated  statistical  skills 

and  computer. 

Hme:  Can  take  a long  time  to  collect  and  fit  the  data. 

Motley:  Costly  in  manpower  and  computer  time. 
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FORECASTING  EVALUATION  FORM  III 


WHAT  IS  IT? 

Name;  GROWTH  CURVES 

Def laltlon/ description;  Many  phenomena  seen  to  follow  the  "S"  shaped  growth 
pattern  of  exponential  growth  slowing  near  a limit.  Forms  of  the  equation 
for  this  pattern  are  known  as  the  Gotnpertz  Curve  and  Pearl  Curve. 

History /degree  of  provenness /promise:  This  has  been  widely  used— but  proven 
only  in  biological  tests. 

WHAT  DO  YOU  CET? 

Uses  and  limitations:  May  be  used  when  data  Tits  and  an  upper  limit  is  known. 

Can  predict  turning  points  in  the  curve. 

Form(s)  of  Output;  Quantitative  forecast  of  a single  quantity  and  turning 
points. 

Level  of  Detail:  Single  variable  over  time. 

Level  ot  Confidence;  When  data  correlates  well  with  growth  model  confidence 
is  high.  The  further  along  the  curve  the  present  is,  the  easier  it  is  to 
achieve  a significant  correlation. 

Span  of  Forecaat:  No  theoretical  limit. 

HOW  1)0  YOU  DO  IT? 

Procedures : Using  historical  data  and  statistical  testB  of  goodness  of  fit 

the  appropriate  curve  is  matched  to  the  data  and  a forecast  la  produced, 

WHAT  DO  YOU  NEED? 


Data  requirements  and  aval lnh  1 1 1 ty ; Historical  data  of  a single  voriuble 
helng  forecast. 

People,  Including  Organizational  back-up:  Sophisticated  statistical  Bkills 

and  usually  a computer. 

Time:  Very  quick  If  data  and  standard  computer  curve  fitting  routines 

ore  available. 


FORECASTING  EVALUATION  FORM  ill 


WHAT  IS  IT? 

Name l LINK-RELATIVE  PREDICTION  OF  TURNING  POINTS 

Def inltlon/descriptiont  This  ia  a way  of  accounting  for  short-term  change* 
in  time  aeriea  trends  by  considering  the  average  change  over  each  historical 
interval, 

Hlstory/dearee  of  provenness/proalsei  As  this  is  a fairly  naive  method  in 
that  it  has  no  associated  causal  model*  it  is  not  widely  used, 

WHAT  DO  YOU  GET? 

Uses  and  limitations:  Good  for  very  short  term,  i.e.,  the  next  time  Interval. 

?orm(a)  of  Output;  An  adjustment  factor  to  modify  the  forecast  for  the 
next  interval. 

Level  of  Detail i One  variable  over  time. 

Level  of  Confidence!  Fairly  high  in  the  short  term  when  the  interval  to 
interval  variance  la  low,  i.e.,  a highly  linear  trend. 

Span  of  Forecast i The  next  time  interval. 

HOW  DO  YOU  DO  IT? 

Procedures!  The  average  of  the  percent  changes  over  intervals  is  calculated. 
It  is  then  applied  to  the  forecast  value. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability!  Historical  data  over  equal  intervale. 
People.  Including  Organisational  liack-up;  Requires  no  sophisticated  skills. 
Time!  Very  quick. 

Money : Very  inexpensive. 


hi 


J 


FORECASTING  EVALUATION  FORM  ffl 


WHAT  IS  IT? 

Name:  BOX-JENK1NS 

Deflnltlon/deacriptlon:  Designed  to  handle  complex  time  aeries  or  where  the 
basic  pattern  is  not  apparent.  Through  a series  of  iterations  the  underlying 
pattern  of  the  data  is  identified.  This  pattern  is  then  UBed  to  generate  the 
forecast. 

History /dentes  of  provonflesn /promise;  Fairly  new  (1970),  considered  power- 
ful but  difficult. 

WHAT  DO  YOU  0ET7 

Uses  and  limitations;  Used  for  complex  data,  but  costly  and  time  consuming. 
Form(s)  of  Output:  Quantitative  forecast  baaed  on  multiple  variubluB. 

l.cvel  of  Detail:  Can  handle  many  variables. 

Level  of  Confidence i Very  Rood  in  the  medium  span. 

Span  of  Forecast!  Short  to  medium,  no  more  than  a few  intervals. 

HOW  DO  YOU  DO  IT? 

Procedures:  An  Initial  pattern  is  specified,  tested  and  modified  through 

several  iterations  using  the  statistical  methods  of  auto  correlation  and 
lagged  variables , 

WHAT  DO  YOU  NEF.U7 

Data  requirements  and  availability:  Time  series  duto. 

People,  Including  Organisational  back-up:  Sophisticated  skills  and  computer. 

Time:  Long  lo  develop  pattern  and  forecasting  algorithm,  brief  to  forecast. 

Morn'll  Expensive  in  development. 
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FORECASTING  EVALUATION  FORM  #1 

WHAT  IS  IT? 

Name;  CYCLE  ANALYSIS 

Definition/ description i A variety  of  trends  seem  to  follow  cyclic  patterns. 
If  the  cycle  can  be  identified  it  can  be  used  to  modify  trend  forecasts  by 
specifying  the  turning  points. 

Hlatory/degree  of  provenneas/promise;  Short  term  (e.g.  business  cycles)  are 
widely  used.  Longer  term  (e.g.  Kondratleff  Wave)  are  more  questionable. 

WHAT  DO  YOU  CET? 

Uses  and  limitations i May  be  used  primarily  to  Identify  turning  points  in 
known  trends.  Many  longer  term  cycles  are  highly  debatoble  as  to  the  reality 
of  the  cyclic  behavior. 

Form(s)  of  Output;  Forecast  of  turning  point. 

Level  of  Detail;  Usually  quite  broad  (e.g.  all  economic  activity). 

Level  of  Confidence;  Short  term-high,  long  term??? 

Span  of  Forecast;  Usually  one  pass  through  the  full  cycle. 

HOW  DO  YOU  DO  IT? 

Procedures;  Identify  the  relevant  cycle  and  the  timing  of  the  next  turning 
point. 

WHAT  DO  YOU  NEED? 


Data  requirements  and  availability;  Access  to  Information  on  cyclic  behavior 
and  available  forecast  data. 

People,  Including  Organ! rational  Back-up;  Requires  someone  (usually  statistician) 
to  evaluate  relevance  of  cycle  to  problem  at  hand. 

Time;  Brief. 


Nurievs  Low  cost. 


Steiner  1969,  p.  390-41 2 
Jiintsrh  J 969 , p.  239 


FORECASTING  EVALUATION  FORM  #1 


VWAT  IS  IT? 

Name:  SYSTEMS  ANALYSIS 

Def lnlt Ion/ dune  rip t Ion:  Broudly,  systems  analysis  refers  to  an  orderly 

analytic  study  of  a system  which  is  designed  to  help  a decision-maker 
identify  a preferred  course  of  action  from  among  possible  alternatives  to 
uchieve  an  objective.  It  Is  primarily  an  "art"  that  requires  specialized 
mathematical  techniques  of  Operations  Research. 

Ulstory/degrec  of  provantieaa /promise;  Developed  by  the  RAND  Corporation  in 
1948  tooptlmize  complex  prol'lems  of  military  management.  Wide  application 
in  the  L'.S,  Besides  military  applications,  this  approach  is  used  in  industry 
for  market  (demand)  factors,  supply  alternatives  and  in  social  science  and 
general  planning. 

.P°.  .19 k Ailil?  a way  to  deal  effectively  with  important,  broad,  and  ill- 
structured  problems.  It  is  not  a tool  or  technique  so  much  as  a way  of 
thinking. 

Uses  and  limitations;  Take  a large  task  and  divide  It  into  manageable 
aubtaaks.  Helps  Ueclu ion-makers  to  sharpen  their  judgments. 

Problems:  (1)  fall  to  address  the  problem;  (2)  rely  too  heavily  on  the 

quantitative  methods  ns  to  forget  the  "real  world."  Also,  the  analysis  is 
necessarily  incomplete  and  approximate. 

Form(a)  of  Output:  Problem  dependent;  however,  usuully  numerical  results 

often  associated  with  coHts  as  a selection  criteria. 

Level  of  Detail:  Although  generalized  application  tu  broad  scope  problems, 

the  methods  often  focus  on  specific  details. 

Level  of  Confidence:  A standard  approach  in  engineering  and  accepted  in 

most  other  fields.  Tends  to  be  too  mathemnt leal  for  many  interests. 

Span  of  Forecast:  Covers  rhe  entire  span  of  forecasts  short,  medium  and 

long-range. 

HOW  DC)  YOU  DO  IT? 


Procedures : (1)  Formulate  the  problem,  (2)  choose  objectives,  (JJ  define 

the  environment,  and  (4)  judge  the  reliability  of  data  and  the  analyst. 

UIIA'i'  DO  YOU  NEED?  Depends  on  the  specific  problem. 

bate  requirements  and  availability:  Depends  upon  the  specific  problem. 

Systems  Analysis  : An  approach  to  complex  problems  of  choice  under  uncertainty 

by  systematically  examining  the  costs,  effectiveness,  and  risks  of  various 
alternst  Jvi-s  (Quade  1973). 
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Steiner,  I9f>9,  p.  449-46 
and  David  13.  Hertz,  "Invest- 
ment Polit  ies  that  I'  v Off," 
Harvard  Business  KevUv,,  Vo  I.  46, 
Jan/Feb  1968  p.  96. 


FORECASTING  EVALUATION  FORM  ill 


WHAT  IS  IT? 


Name:  RISK  ANALYSIS  SIMULATION 

Def Intclon/deserlptlon:  A computer  simulation  to  improve  capital  invaatment 

decision  making  and  maximize  the  changes  of  attaining  long-term  dollars  and 
cents  investment  objectives.  Assists  in  establishing  an  investment  policy, 

History/ degree  of  provenneas/rromiaa;  Developed  by  David  Hertz  (prior  to  1964) 
to  Improve  Investment  decisions.  Despite  this  description)  the  simulation 
should  ho  further  explored  tor  Corpa  application. 

WHAT  DO  YOU  CET? 


lines  and  limitation!:  Simulates  possible  investment  outcomes  to  get  distribution 
of  probabilities  concerning  payoff  and  aasassss  the  risk  of  various  policias 
to  provide  a moans  of  making  effective  investments  for  growth.  Limitations i 
selecting  key  factors  and  assigning  uncertainty  profiles!  also,  choice  of 
criteria  against  which  to  measure  results. 

Fora(s)  of  Output:  A risk  profile  or  a probability  distribution  for  future 
revenues  from  a given  Investment. 

hovel  of  Detail:  Aggregate  level  of  detail,  baaed  on  broad  factors  and  criteria. 

l.uvel  of  Confidence:  Higher  than  existing  one-point  estimate. 

Span  of  Forecast:  Probability  of  return  on  1 to  10-year  Investments  usually 

simulated  over  a 15-year  period. 

HOW  DO  YOU  DO  JT ? 


I'rnr.edures : Yus:  (1)  Construct  uncertainty  profiles  for  each  important  factor. 

(T)  Computer  simulates  an  actual  situation. 

(3)  Computer  combines  the  values  selected  and  determines  a return  on 

InvcHtment  for  this  particular  situation, 

(4)  Computer  reports  this  process  and  calculates  ROI  several  thousand  times. 

(5)  Computer  lists  the  results  and  specifies  the  number  of  times  the  ROI 

falls  in  a given  range. 

(6)  Cumulative  probabilities  can  then  be  used  to  draw  a risk  profile. 

WHAT  DO  YOU  NEED? 

■li'Tsa—  urn, ■ 

Data  requirements  and  availability:  Data  sometimes  determined  from  historical 

or  other  objective  data,  but  usually  subjective  estimates  by  those  familiar 
with  the  problem.  Communication  problems  with  subjective  estimates. 

People,  Including  Organizational  Back-upi  Decision  makers  familiar  with 
problem  and/or  analyst  knowledgeable  about  simulation.  Computer  backup. 

Time:  Lens  than  6 months. 

Money:  Low  to  medium  (guess) . 
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Jantach  1969,  p.  171 
FORECASTING  EVALUATION  FORM  111 

WHAT  IS  IT? 

Watt  CONTEXTUAL  MAPPING 

Daflnltlon/deacriptloni  Contextual  tupping  it  t type  of  exploratory  fore- 
eiating.  It  it  t broad  concept  utad  to  follow  eonbinationi  of  currant  and 
poatibla  future  ttchnologiat  in  axpactad  future  environments. 

Hittory /detree  of  provennett/prottltei  Utilited  by  the  RAND  Corporation  in  the 
late  1940 ^e.  Applied  mainly  to  ailitary  planning  and  induttritl  technological 
developments.  Saani  to  have  been  epplied  very  tuccetefully,  but  1 an  not  aura 
what  it  is, 

WHAT  DO  YOU  PET? 

Ueet  and  limitation! i Quantitative  contextual  napping  la  of  particular  valua 
in  forecasting  the  effects  of  acallng.  Used  generally  in  defining  new  niaeione 
and  concaiving  future  conplex  syatena.  It  ie  considered  of  potential  value 
within  the  framework  of  social  technology, 

Form(a)  of  Output!  Detailed  charta  or  picture  flowe  (7) 

Level  of  Detail i A wide  range  from  minute  detail  tc  genuraliaed  flowa. 

Level  of  Confidence i Generates  new,  though  "inaccurate",  information  about 
specific  functional  capabilities  or  parameters. 

Scan  of  Forecast i Long-range  forecasts, 

HOW  DO  YOU  DO  IT?  Need  other  reference!. 

Procedures; 

WHAT  DO  YOU  NEED7 

Data  requirements  and  availability; 

People,  Including  Organisational  Back-up: 

Time! 

Money ; 
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R.E.  Bain,  et  al.,  "A  Model  of  the  Energy 
Market,"  1973-74  Draft. 

Personal  Communication,  S.Baum  & E. Cazalet 
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FORECASTING  EVALUATION  FORM  FI 


WAT  19  IT? 

Name  I SRI  GULF  ENERGY  MODEL 

Def  ir.lt  lon/dtscrlptloni  An  energy  market  model  whose  purpoaa  ia  to  compute 
energy,  auppliea,  damanda,  and  prices  over  a given  horlson.  The  mathematical 
algorithms  determine  the  equilibrium  between  supply  and  demand  based  on  price. 

Hletorv/datrea  of  orovemieee/ promise)  Developed  in  1973-74  by  SRI  for  Gulf 
bil  Corporation,  Considerable  promise.  Gulf  ia  incorporating  existing  model 
into  its  management  structure  and  SRI  is  proceeding  with  further  expansion 
and  discrimination.  General  methodology  may  ba  applied  to  other  activities 
and  at  various  levels  of  detail.  Corps  may  be  a potential  user. 

^uDY^m? 

Uses  and  limitations!  Based  on  proj acted  consumption,  the  model  computes  prices 
for  selected  energy  sources.  Fro j acts  market  prices  and  energy  flows  through- 
out the  U.S.  energy  system  by  balancing  supply  and  demand.  Limitation t Runs 
and  tasting  tend  to  be  costly;  decision  focused  on  epeclflc  supply/demand 
problems;  and  preaent  "red  tape"  Involved  with  acquisition  end  use.  At  the 
present  time,  mors  like  a paid  service  than  tool  to  work  with. 

Form(s)  of  Output t Computer  listing  and  graphs  of  supply,  damand  and  priesa 

on  a raglonal  bails  for  various  forma  of  ansrgy  rasourcss  and  lsvels  of  tschnology. 

Laval  of  Dstslli  National  modsl  with  raglonal  da tall, 

Laval  of  Confidancai  Both  proponents  and  customers  show  enthusiasm  for  this 
model  es  e decision  analysis  tool.  While  the  modsl  is  new  end  there  has  baan 
only  one  application,  designers  express  confidence  in  the  basic  design  and 
methodology. 

Span  of  Forecast i "Precision"  geared  to  medium  or  long-term  forpeaete. 

HOW  DO  YOU  DO  IT7 


Procedures ; Since  the  modal  ie  running  the  procedure  to  use  it  in  its  present 
Form  is  mainly  related  to  data  review  and  model  acquisition. 

WHAT  DO  YOU  NEED? 


Data  requirements  and  availability!  Critical  data  inputa  but  not  large  volumes 
of  historical  data.  Soma  data  baaed  on  subjective  estimate*.  Date  generally 
available;  however,  user  must  pay  royalties  to  use  the  model. 

People.  Including  Organizational  Back-up i At  the  present  time,  it  ie  neces- 
eery  to  contact  either  SRI  or  Gulf  to  acquire  and  become  familiar  with  the  model. 

Time i Primarily  for  acquiring  the  model,  familiarization,  and  data,  review 
and  interpretation. 

Money i Medium  to  high:  $200  - $500/run. 

Development  coata  at  1/2  million  dollars. 


I 
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Jantsch,  1969,  p.  200 


FORECASTING  EVALUATION  FORM  HI 


WHAT  IS  IT? 

Name i GAMES 

Daflnltlon/deacrlptlon;  Caning  la  a apaeial  type  of  nodal-building,  structured 
ao  aa  to  parnit  multipla  aiaultanaoua  lntaractlona  emong  competing  and  cooperating 
playara. 

Hlatory/dagraa  of  provennaaa/proBlsei  Casing  haa  axparlancod  a wide  range  of 
applleatlona  from  nllitary  war  gamaa  to  induatrlal  atratagy  to  social  planning 
and  development.  Caning  can  be  extended  up  to  the  highest  lavala  of  social 
ays  tana  and  society,  and  is  becoming  recognised  ae  one  of  the  potentially 
moat  suitable  techniques  for  "social  engineering", 

WHAT  DO  YOU  OET7 


Uses  and  limitations i Can  be  used  for  studying  the  implications  for  the  future 
of  combinations  of  specific  strategic  concepts.  Seems  tote  an  effective  neana 
of  forecasting  the  possible  impact  of  new  or  future  plana  to  a limited  number 
of  players, 

Form(a)  of  Output;  Besides  the  individual  perceptions  and  experiences  acquired 
during  genes,  most  huve  some  type  of  quantitative,  measurable  output. 

Level  of  Detail  I Generalised  and  aggregate.  Can  be  used  for  studying  the 
implication*  uf  future  scenarios. 

Level  of  Confidence  I Highly  subjective  but  testing  procedures  indicate 
excellent  learning va lue . 

Span  of  Forecast)  No  limits, 

HOW  DO  YOU  PO  IT? 

Procedures;  Most  games  employ  a structured  but  flexible  framework  in  which 
players  must  operate. 

WHAT  HO  YOU  NEED? 

Data  requirements  ami  availability;  People  and  a game.  Development  may  require 
historical  or  hypothetical  case  Btud ius . 

People,  Including  Organisational  Back-up;  Any  number  of  player*,  ranging  from 
two  to  200 ; the  average  la  10  to  30. 

Time;  The  actual  game  ueually  requires  from  one  day  to  one  week.  Preparation 
and  development  time  may  be  lengthy. 

Muncy ; Costa  for  development,  preparation,  players  and  often  computer.  Small 
to  medium. 
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FORECASTING  EVALUATION  FORM  FI 

WHAT  IS  IT? 

Name:  POLICY  CAPTURE 

Definltlon/deecription:  A small  group  technique.  Utilises  multivariate 
statistical  analysis  to  compute  explicitly  the  relative  importance  assigned 
to  different  variables  in  a problem  based  upon  the  assigned  praferancaa  for 
different  solution  scenarios  for  a problem. 

Hlstorv/dearee  of  provenness /promise:  Developed  by  K.  R.  Hammong,  Univarsity 
of  Colorado  in  (guess)  late  1960's.  Besides  a mapping  of  human  judgments, 
policy  capture  can  be  used  to  generate  effectiveness  measures  for  budgetry 
decisions.  High  degree  of  promise. 

WHAT  DO  YOU  GET? 

Uses  and  limitations:  Policy  capturing  provides  normative  information  on  the 
ramifications  of  alternative  policies  in  order  to  surface  issues  imbedded  within 
the  problem  situation.  No  "sure"  method  to  select  the  proper  set  of  cues; 
need  policy  people  who  are  hard  to  get,  analysis  dependent  on  linear  regression. 

Form(a)  of  Output:  Numerical  values  and/or  bar  charts  and  computer  graphics 

ior  each  cue  showing  relative  weights,  preferences,  and  "way  of  thinking," 

Level  of  Detail:  Aggregate  variables  (5  to  10)  used  to  describe  problem  or 
situation.  ~ 

Level  of  Confidence:  General  level  of  acceptance  is  high,  excellent  opportunity 

iar  feedback  and  ref insment . 

Span  of  Forecast:  Scenarios  may  extend  into  any  time  frame. 

Procedures:  1.  Discuss  the  problem  and  formulate  the  cubb  or  variables, 

2.  Pretest:  set  up  program  and  administer. 

3.  Data  analysis 

4.  Present  results  and  review 

vmAyojoynD? 

Data  requirements  and  availability:  Subjective  data.  Inputs  on  preselected 

questions  from  participants. 

People,  Includlnu  Organisational  Back-up:  Works  best  with  people  directly 
involved  in  the  problem.  Need  access  to  Policy  II  computer  program. 

Time:  Development  time  less  than  6 months.  To  administer  teat  takes  from 

1 day  to  1 week. 

Money:  Low  to  medium.  Requires  extensive  preparation  and  pretesting,  as 
well  aa  computer  costs  @ SB  to  $2Q/run. 
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FORECASTING  EVALUATION  FORM  II L 

W1AT  IS  IT? 

Nnmci  PROBABILISTIC  FORECASTING 

Deflnltlon/descrlption;  Various  statistical  methods  that  lncludo: 

Stochastic  prreesHos;  chain  of  events  with  transition  probabilities  that 
are  not  affected  by  what  happened  at  earlier  utageu. 

Markov  chains i a stochastic  process  for  which  all  transition  probabilities 
could  be  determined . 

Gausslsm  normal  distribution  charactsrlssd  by  the  standard  deviation. 
Bayaaisn  scatiaticsi  non-Markov  and  posaibla  to  update  probability  dia- 
tributions  by  the  Introduction  of  new  duta, 

Monte  Carlo!  is  an  experimental,  not  an  analyric.il,  technique  by  which 
a sequence  of  evsnta  with  random  combination  of  probability  values  is 
applied  to  determine  the  probability  distribution. 

Parametric  Sensitivity  Analysis;  mainly  used  to  evaluate  ihe  importance 
of  variables  in  a system. 

WHAT  DO  YOU  GET? 

Usee  and  limitations!  Probabilistic  forecasting  can  ba  applied  only  where  the 
possible  outcome  can  be  defined  beforehand. 

Korm(e)  of  Output!  Graph*  or  tablee  with  best  estimates  or  probabilities 
and  indications  of  limits,  ranga,  or  error, 

Level  of  Detail i Detailed  numerical  results  for  technical,  scientific  problems. 

Level  of  Confidence!  High  for  the  purpose  of  scientific  calculations. 

Forecasts  dependent  on  subjective  estimates. 

Span  of  Foteceeti  Short  to  medium. 

|oyywMiT? 

Procedures i Application  of  (pacific  assumptions  and  equations  for  each  of 
the  various  techniques, 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability!  Understanding  of  the  problem  and  the 
correct  technique  to  apply  - data  not  uaually  a limitation. 

fWPlt.  JnsMiai  Smniuilsaax.  Stetieticiena  and  analyst.. 

Tims i Short  for  application. 

Monay:  Small  to  medium.  May  require  computer  backup. 
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FORECASTING  EVALUATION  FORM  01 

Name  I NORMEX 

Daflnitlon/deacriPtioni  Because  £hla  approach  appllaa  exploratory  (trend  extra- 
polation) technique*  to  obtain  a normative  (that  ia,  need  or  goal*  oriented) 
type  of  forecast,  the  technique  was  termed  "NORMEX"  forecaeting.  The  tool  la 
baaed  on  a mathematical  procedure  that  allow*  the  planner  to  predict  the  future 
relationship*  expected  to  exist  between  goals  and  existing  trends. 

History/ degree  of  provsnnass /promise i Wade  Blackman  presantad  mathematical 
procedures  in  early  1970s  and  applied  term  Normex  to  earlier  (1968)  studies 
of  technology  and  market  demand  of  the  computer  memory  market.  Has  since 
been  used  in  industrial  marketing  atudiea.  (More  info  needed  for  other  appli- 
cations but  main  uses  so  far  are  on  technological  performance). 

WHAT  DO  YOU  GET7 

Uses  and  limitations i Allows  planners  to  resolve  the  interfacing  problem  between 
two  forecasts  and  provides  an  improved  indication  of  the  future.  Can  serve  to 
establish  goals  and  priorities  for  programs  necessary  to  achieve  the  requirements 
demanded  by  the  "market"  in  a specified  future  time  period.  Also  useful  to 
indicate  tradeoffs  and  measure  uncertainty  associated  with  future  forecasts. 

Torm(s)  of  Output i Time  series  extrapolations,  frequency  distributions, 
cumulative  frequency  distributions  and  graphs  of  means  and  standard  deviations 
of  selected  parameters  over  time. 

Level  of  Detail;  Detailed  atudisa  of  specific  problem.  However,  aounda  like 
it  could  he  expanded  to  broader  scope  planning. 

level  of  Confldencei  Provides  useful  consiatency  checks  of  several  forecasts. 
However  there  1b  still  uncertainty  and  this  technique  assumes  that  current  trends 
will  continue. 

Span  of  Forecast i Medium  to  long  term, 

HOW  DO  YOU  DO  IT? 


Procedures!  (1)  Collect  historical  data;  (2)  construct  histograms  (frequency 
distributions);  (3)  plot  cumulative  frequencies  on  log  normal  probability  paper; 
(4)  estimate  mean  and  standard  deviation  from  Step  3;  (5)  plot  means,  etc., 
versus  time  and  extrapolate;  (6)  apply  Normex  equation  to  values  from  Step  4 
along  elth  extrapolation  of  historical  data  from  Step  1. 

^|J0_Y2UNK|? 

Data  requirements  and  availability!  Historical  data  for  selected  parameters. 

People.  Including  Organisational  Back-up;  Understanding  of  some  mathematics 
and  statistics. 

Time!  Short  to  medium. 

Money;  Low  level  effort  to  apply  technique  to  existing  data. 
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FORECASTING  EVALUATION  FORM  #1 


WHAT  IS  IT? 

Name!  SUBSTITUTION  FORECASTING 

Deflnltion/daacrlptlont  Thie  la  a means  for  pradictlng  tha  aubatitution  of 
an  axlatlng  tachnology  by  a new  technology.  The  underlying  theory  la  that 
one  technology  (without  a major  change  In  function)  will  diaplace  another  aa 
predicted  by  a hyperbolic  tangent  function  baead  on  the  annual  rate  of  die- 
placement. 

Hletory/dearee  of  provenneea/promieei  Method  haa  been  uead  extenaivaly  in 
estimating  future  market  a lea.  need  for  production  facilities,  phaee-out  of 
old  technologies,  ate.  The  technique  la  far  from  proven  becauae  of  aavaral 
important  limitatlona. 

WHAT  DO  YOU  GET7 

Ueee  and  limitationai  Ueeful  for  ayatamatic  analytic  of  impacta  of  changing 
technologiae.  Prediction*  baead  on  the  firat  5-10X  diaplacament  are  auapaett 
they  appear  to  be  much  more  accurate  if  baaed  on  25X  of  more  aubatitution. 

Unite  of  meaoureaant  muat  ba  carefully  aelected.  The  long  time  span*  involved 
in  tuny  displacement*  mean*  that  traditional  rataa  are  often  distorted  by 
environmental  change  and/or  atill  newer  technologic*. 

Form(a)  of  Output i Curve*  fitted  to  formulaei  tables)  diacusaiona  of  primary 
and  secondary  impacts  of  competing  technologies. 

Level  of  Detail i Usually  intermediate  level  of  detail,  auch  a*  diaplacament 
of  aall  by  ataam  ship*  or  of  steel  by  plastic  in  auto  construction.  In  theory 
can  ba  detailed  or  gross. 

Level  of  Confidence)  In  well-nstabllahed  reletionship*  reasonably  well- 
advanced,  confidence  ia  high.  Very  often,  however,  conclusions  are  reached 
too  early  in  the  substitution,  much  lowering  the  confidence  level. 

Span  of  Forecaati  Ranges  from  near-torm  to  a century  or  more. 

HOW  DO  YOU  DO  IT7 

Procedures!  On  the  basis  of  history  one  calculates  the  tske-over  rate.  This 
formula  is  applied,  aometimea  with  judgmental  adjustment,  to  predict  the 
future.  The  procedure  la  claarly  one  type  of  trend  extrapolation. 

WHAT  DO  YOU  NEED? 

Data  requirements  and  availability!  Need  historical  time  aerie*  in  enough 
detail  to  aupport  mathematical  analysis.  Such  data  are  frequently  available. 

People.  Including  Organisational  Back-up!  Skill  level  ia  not  high. 

Timet  Data  collection  and  analysis  is  more  time  consuming  than  the  projecting. 
Overall  time  depends  on  ease  with  which  data  cen  be  obtained. 

Honey;  Depends  on  time.  In  a few  cases  substitution  forecasting  might  be 
dene  for  a few  hundred  dollars.  Many  thousands  would  be  required  in  more 
time-consuming  circumstances. 
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Description  of  73  forecasting  techniques  / Arnold 
Mitchell,  Burnham  H.  Dodge... Cet  al.I.  — Fort 
Belroir,  7a.  : U.S.  Institute  for  Water  Resources, 

1977. 

74  p.  (IWR  contract  report  ; no.  75-7,  Supp. 

(Part  l)) 

This  suppleaent  to  the  Handbook  of  forecasting 
techniques  (IWR  contract  s-n  rt  75-7)  i»  in  two  parts. 

1.  Forecasting.  2.  Simulation.  I.  Title.  II.  Dodge, 
Burnham  H.,  .1  oint  author.  III.  3erles:  U.S.  Institute 
for  Water  Resources.  Contract  report  75-7 • Supp.  (Port  l). 
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